Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 07:59:56 devstack cinder-volume[72512]: INFO dbcounter [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Registered counter for database cinder Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG oslo_db.sqlalchemy.engines [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG dbcounter [-] [72512] Writer thread running {{(pid=72512) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 07:59:56 devstack cinder-volume[72512]: INFO cinder.rpc [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 01 07:59:56 devstack cinder-volume[72512]: INFO cinder.rpc [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG oslo_db.sqlalchemy.engines [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 07:59:56 devstack cinder-volume[72512]: INFO cinder.volume.manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Determined volume DB was empty at startup. Apr 01 07:59:56 devstack cinder-volume[72512]: DEBUG cinder.volume.manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72512) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 01 07:59:56 devstack cinder-volume[72512]: INFO cinder.volume.manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 01 07:59:56 devstack cinder-volume[72512]: WARNING stevedore.named [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 01 07:59:56 devstack cinder-volume[72512]: WARNING castellan.key_manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 07:59:56 devstack cinder-volume[72512]: WARNING cinder.keymgr.conf_key_mgr [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG cinder.volume.drivers.lvm [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72512) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_concurrency.processutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72512) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_concurrency.processutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] CMD "cinder-rtstool verify" returned: 0 in 0.246s {{(pid=72512) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_db.sqlalchemy.engines [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 07:59:57 devstack cinder-volume[72512]: INFO cinder.rpc [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 01 07:59:57 devstack cinder-volume[72512]: INFO cinder.rpc [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 01 07:59:57 devstack cinder-volume[72512]: WARNING stevedore.named [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 01 07:59:57 devstack cinder-volume[72512]: WARNING castellan.key_manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 07:59:57 devstack cinder-volume[72512]: INFO cinder.volume.manager [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_db.sqlalchemy.engines [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 07:59:57 devstack cinder-volume[72512]: INFO oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Starting 1 workers Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Started child 72657 {{(pid=72512) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Full set of CONF: {{(pid=72512) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] ******************************************************************************** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Configuration options gathered from: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] ================================================================================ {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] allow_availability_zone_fallback = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] allow_compression_on_image_upload = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] allowed_direct_url_schemes = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] api_rate_limit = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] auth_strategy = keystone {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] az_cache_duration = 3600 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_availability_zone = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_host = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_stats_polling_interval = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backup_api_class = cinder.backup.api.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backup_name_template = backup-%s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backup_use_same_host = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backup_use_temp_snapshot = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] chap_password = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] chap_username = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_internal_tenant_project_id = 8a934f7239d546aa855331b82cb18880 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_internal_tenant_user_id = 70b1144706954406b5979cc00e3f5ea4 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cloned_volume_same_az = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cluster = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] compression_format = gzip {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] compute_api_class = cinder.compute.nova.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72657]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] config_dir = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] config_source = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] control_exchange = openstack {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] debug = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] default_availability_zone = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] default_group_type = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] default_volume_type = lvmdriver-1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] disk_geometry = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_client_cert = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_client_cert_key = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_data_namespace = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_ssl_cert_path = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_ssl_cert_verify = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] driver_use_ssl = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] enable_force_upload = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] enable_new_services = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] enable_unsupported_driver = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] enabled_backends = ['lvmdriver-1'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] enforce_multipath_for_image_xfer = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] filter_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_api_insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_api_ssl_compression = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_ca_certificates_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_catalog_info = image:glance:publicURL {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_num_retries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance_request_timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] goodness_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] graceful_shutdown_timeout = 5 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] group_api_class = cinder.group.api.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] host = devstack {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_compress_on_upload = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_conversion_address_space_limit = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_conversion_cpu_limit = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_conversion_disable = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_upload_use_cinder_backend = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_upload_use_internal_tenant = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_volume_cache_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_volume_cache_max_count = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] image_volume_cache_max_size_gb = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] init_host_max_objects_retrieval = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] instance_format = [instance: %(uuid)s] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iscsi_target_flags = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iscsi_write_cache = on {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iser_helper = tgtadm {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iser_ip_address = 192.168.122.46 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iser_port = 3260 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_color = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_config_append = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_dir = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_options = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_rotate_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_rotate_interval_type = days {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] log_rotation_type = none {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] max_age = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] max_logfile_count = 30 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] max_logfile_size_mb = 200 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] max_over_subscription_ratio = 20.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] message_reap_interval = 86400 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] message_ttl = 2592000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] migration_create_volume_timeout_secs = 300 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] monkey_patch = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] monkey_patch_modules = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] my_ip = 192.168.122.46 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] no_snapshot_gb_quota = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] num_iser_scan_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] num_shell_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] num_volume_device_scan_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] nvmeof_conn_info_version = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] nvmet_ns_id = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] nvmet_port_id = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_max_limit = 1000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_ext_list = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_listen = 0.0.0.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_listen_port = 8776 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72657]: INFO cinder.volume.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_use_ssl = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] osapi_volume_workers = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] per_volume_size_limit = -1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] periodic_fuzzy_delay = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] periodic_interval = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] project_id_regex = [0-9a-f\-]+ {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] public_endpoint = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] publish_errors = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_backup_gigabytes = 1000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_backups = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_gigabytes = 1000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_groups = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_snapshots = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] quota_volumes = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] rate_limit_burst = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] rate_limit_except_level = CRITICAL {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] rate_limit_interval = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] reinit_driver_count = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] replication_device = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] report_discard_supported = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] report_interval = 120 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] reservation_clean_interval = 86400 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] reservation_expire = 86400 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] reserved_image_namespaces = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] reserved_percentage = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] rpc_response_timeout = 120 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] run_external_periodic_tasks = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] scst_target_driver = iscsi {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] scst_target_iqn_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_down_time = 720 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] shell_completion = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] snapshot_name_template = snapshot-%s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] snapshot_same_host = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] split_loggers = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] state_path = /opt/stack/data/cinder {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] storage_availability_zone = nova {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] storage_protocol = iSCSI {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] syslog_log_facility = LOG_USER {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_helper = lioadm {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_ip_address = 192.168.122.46 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_port = 3260 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_protocol = iscsi {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] target_secondary_ip_addresses = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] trace_flags = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] transfer_api_class = cinder.transfer.api.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] transport_url = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] until_refresh = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_chap_auth = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_default_quota_class = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_journal = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_json = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_multipath_for_image_xfer = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_stderr = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] use_syslog = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] verify_glance_signatures = enabled {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_api_class = cinder.volume.api.API {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_backend_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_clear = zero {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_clear_ionice = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_clear_size = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_copy_bps_limit = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_dd_blocksize = 1M {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_name_template = volume-%s {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_service_inithost_offload = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volume_usage_audit_period = month {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] zoning_mode = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_concurrency.disable_process_locking = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.admin_password = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.admin_token = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.admin_user = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_admin_prefix = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_port = 35357 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_protocol = https {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_section = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_type = password {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_uri = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.auth_version = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.cache = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.delay_auth_decision = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.http_connect_timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.identity_uri = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.include_service_catalog = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.interface = public {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_password = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcache_username = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.region_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.service_token_roles_required = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.service_type = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.token_cache_time = 300 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.backend = dogpile.cache.null {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.backend_argument = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.backend_expiration_time = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.config_prefix = cache.oslo {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.debug_cache_backend = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.enable_retry_client = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.enable_socket_keepalive = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.enforce_fips_mode = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.expiration_time = 600 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.hashclient_retry_attempts = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_dead_retry = 300 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_pool_maxsize = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_sasl_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.password = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.proxies = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.redis_db = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.redis_sentinel_service_name = mymaster {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.redis_server = localhost:6379 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.retry_attempts = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.retry_delay = 0.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.socket_keepalive_count = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.socket_keepalive_idle = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.socket_keepalive_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.socket_timeout = 1.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.tls_allowed_ciphers = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.tls_cafile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.tls_certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.tls_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.tls_keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cache.username = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] coordination.backend_url = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.asyncio_connection = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.asyncio_slave_connection = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.backend = sqlalchemy {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.connection = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.connection_debug = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.connection_parameters = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.connection_recycle_time = 3600 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.connection_trace = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.db_inc_retry_interval = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.db_max_retries = 20 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.db_max_retry_interval = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.db_retry_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.max_overflow = 50 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.max_pool_size = 5 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.max_retries = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.mysql_wsrep_sync_wait = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.pool_timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.retry_interval = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.slave_connection = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.sqlite_synchronous = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.synchronous_reader = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] database.use_db_reconnect = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.connection_string = messaging:// {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.es_doc_type = notification {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.es_scroll_size = 10000 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.es_scroll_time = 2m {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.filter_error_trace = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.hmac_keys = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.sentinel_service_name = mymaster {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.socket_timeout = 0.1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.trace_requests = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler.trace_sqlalchemy = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler_jaeger.process_tags = {} {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler_jaeger.service_name_prefix = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] profiler_otlp.service_name_prefix = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.enforce_new_defaults = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: WARNING oslo_config.cfg [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.enforce_scope = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.policy_default_rule = default {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.policy_file = policy.yaml {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_policy.remote_timeout = 60.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.group = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.helper_command = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] privsep_osbrick.user = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.group = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.helper_command = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] cinder_sys_admin.user = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.auth_section = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.auth_type = password {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.cafile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.collect_timing = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.send_service_user_token = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.split_loggers = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] service_user.timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.auth_section = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.auth_type = password {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.collect_timing = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.region_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.split_loggers = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] glance.timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.backend_availability_zone = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.chap_password = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.chap_username = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.disk_geometry = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_client_cert = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_client_cert_key = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_data_namespace = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.driver_use_ssl = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.enable_unsupported_driver = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.extra_capabilities = {} {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.filter_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.goodness_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iscsi_target_flags = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iscsi_write_cache = on {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iser_helper = tgtadm {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iser_port = 3260 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.lvm_mirrors = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.lvm_share_target = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.lvm_type = auto {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.num_shell_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.nvmet_port_id = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.replication_device = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.report_discard_supported = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.reserved_percentage = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.scst_target_driver = iscsi {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.scst_target_iqn_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.storage_protocol = iSCSI {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_helper = tgtadm {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_port = 3260 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_protocol = iscsi {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.trace_flags = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.unique_fqdn_network = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.use_chap_auth = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_backend_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_clear = zero {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_clear_ionice = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_clear_size = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volume_group = cinder-volumes {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_reports.file_event_handler = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_reports.log_dir = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.backend_availability_zone = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.backend_host = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.chap_password = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.chap_username = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.chiscsi_conf = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.disk_geometry = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_client_cert = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_data_namespace = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.driver_use_ssl = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.extra_capabilities = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.filter_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.goodness_function = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack sudo[72661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack sudo[72661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iser_helper = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iser_ip_address = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iser_port = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.iser_target_prefix = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.lvm_conf_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.lvm_mirrors = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.lvm_share_target = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.lvm_type = auto {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.num_shell_tries = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.nvmet_port_id = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.replication_device = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.report_discard_supported = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.reserved_percentage = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.scst_target_driver = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.storage_protocol = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_helper = lioadm {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_ip_address = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_port = 3260 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_protocol = iscsi {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.trace_flags = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.use_chap_auth = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_clear = zero {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_clear_size = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] lvmdriver-1.volumes_dir = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.ssl_version = {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_notifications.driver = [] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_notifications.retry = -1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] oslo_messaging_notifications.transport_url = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] key_manager.fixed_key = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.barbican_api_version = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.barbican_endpoint = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.barbican_endpoint_type = public {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.barbican_region_name = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.cafile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.collect_timing = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.number_of_retries = 60 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.retry_delay = 1 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.send_service_user_token = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.split_loggers = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.verify_ssl = True {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican.verify_ssl_path = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.auth_section = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.auth_type = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.cafile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.certfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.collect_timing = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.insecure = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.keyfile = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.split_loggers = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] barbican_service_user.timeout = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.approle_role_id = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.approle_secret_id = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.kv_mountpoint = secret {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.kv_path = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.kv_version = 2 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.namespace = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.root_token_id = **** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.ssl_ca_crt_file = None {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.timeout = 60.0 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.use_ssl = False {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 07:59:57 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] ******************************************************************************** {{(pid=72512) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 01 07:59:58 devstack sudo[72661]: pam_unix(sudo:session): session closed for user root Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.551s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:58 devstack sudo[72908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 07:59:58 devstack sudo[72908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 07:59:58 devstack sudo[72908]: pam_unix(sudo:session): session closed for user root Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.540s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 07:59:58 devstack cinder-volume[72657]: INFO cinder.brick.local_dev.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:58 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:58 devstack sudo[73142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 07:59:58 devstack sudo[73142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 07:59:59 devstack sudo[73142]: pam_unix(sudo:session): session closed for user root Apr 01 07:59:59 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 07:59:59 devstack cinder-volume[72657]: DEBUG cinder.brick.local_dev.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72657) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 01 07:59:59 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 07:59:59 devstack sudo[73209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 07:59:59 devstack sudo[73209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:00 devstack sudo[73209]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.778s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:00 devstack sudo[73344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:00 devstack sudo[73344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:00 devstack sudo[73344]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.413s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:00 devstack sudo[73348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 01 08:00:00 devstack sudo[73348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:00 devstack sudo[73348]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.410s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:00 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:00 devstack sudo[73352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:00:00 devstack sudo[73352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:01 devstack sudo[73352]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:01 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:01 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:01 devstack sudo[73359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:00:01 devstack sudo[73359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:01 devstack sudo[73359]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:01 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.409s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:01 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:01 devstack sudo[73366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:01 devstack sudo[73366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:02 devstack sudo[73366]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:02 devstack sudo[73370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:02 devstack sudo[73370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:02 devstack sudo[73370]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.413s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:02 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:02 devstack sudo[73375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:02 devstack sudo[73375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:03 devstack sudo[73375]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:03 devstack cinder-volume[72657]: INFO cinder.volume.drivers.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:03 devstack sudo[73493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:03 devstack sudo[73493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:03 devstack sudo[73493]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG cinder.volume.drivers.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Updating volume stats {{(pid=72657) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:03 devstack sudo[73496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:00:03 devstack sudo[73496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:03 devstack sudo[73496]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:03 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:04 devstack sudo[73637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:04 devstack sudo[73637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:04 devstack sudo[73637]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:04 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:04 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:04 devstack sudo[73641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:04 devstack sudo[73641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:04 devstack sudo[73641]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:04 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:04 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:04 devstack sudo[73644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:04 devstack sudo[73644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:05 devstack sudo[73644]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:05 devstack cinder-volume[72657]: INFO cinder.volume.driver [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Driver hasn't implemented _init_vendor_properties() Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG cinder.volume.driver [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72657) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG oslo_db.sqlalchemy.engines [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72657) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG dbcounter [-] [72657] Writer thread running {{(pid=72657) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG cinder.db.sqlalchemy.api [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Building query based on filter {{(pid=72657) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG cinder.image.image_utils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72657) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 01 08:00:05 devstack cinder-volume[72657]: INFO cinder.keymgr.migration [None req-8343c948-10de-458a-96ee-6bd041592ef1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG cinder.volume.drivers.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Updating volume stats {{(pid=72657) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:05 devstack sudo[73652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:00:05 devstack sudo[73652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:05 devstack sudo[73652]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:05 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:05 devstack sudo[73656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:05 devstack sudo[73656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:06 devstack sudo[73656]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:06 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:06 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:06 devstack sudo[73660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:06 devstack sudo[73660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:06 devstack sudo[73660]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:06 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:06 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:06 devstack sudo[73664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:06 devstack sudo[73664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:07 devstack sudo[73664]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG cinder.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Notifying Schedulers of capabilities ... {{(pid=72657) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:00:07 devstack cinder-volume[72657]: INFO cinder.volume.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Driver initialization completed successfully. Apr 01 08:00:07 devstack cinder-volume[72657]: INFO cinder.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Initiating service 2 cleanup Apr 01 08:00:07 devstack cinder-volume[72657]: INFO cinder.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Service 2 cleanup completed. Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG cinder.service [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Creating RPC server for service cinder-volume {{(pid=72657) start /opt/stack/cinder/cinder/service.py:231}} Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG cinder.service [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72657) start /opt/stack/cinder/cinder/service.py:237}} Apr 01 08:00:07 devstack cinder-volume[72512]: DEBUG dbcounter [-] [72512] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72512) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:00:07 devstack cinder-volume[72657]: INFO cinder.volume.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG cinder.volume.drivers.lvm [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Updating volume stats {{(pid=72657) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:07 devstack sudo[73673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:00:07 devstack sudo[73673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:07 devstack sudo[73673]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:07 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:07 devstack sudo[73677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:07 devstack sudo[73677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:08 devstack sudo[73677]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:08 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:08 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:08 devstack sudo[73734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:00:08 devstack sudo[73734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:08 devstack sudo[73734]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:08 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:08 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:00:08 devstack sudo[73737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:00:08 devstack sudo[73737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:00:09 devstack sudo[73737]: pam_unix(sudo:session): session closed for user root Apr 01 08:00:09 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:00:09 devstack cinder-volume[72657]: INFO cinder.volume.manager [None req-961e1e82-b4ef-4271-b10b-1f60d77427eb None None] Driver post RPC initialization completed successfully. Apr 01 08:00:17 devstack cinder-volume[72657]: DEBUG dbcounter [-] [72657] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72657) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:00:19 devstack cinder-volume[72657]: DEBUG dbcounter [-] [72657] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72657) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:01:52 devstack cinder-volume[72657]: DEBUG oslo_service.periodic_task [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72657) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:01:52 devstack cinder-volume[72657]: DEBUG cinder.volume.drivers.lvm [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Updating volume stats {{(pid=72657) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 01 08:01:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:01:52 devstack sudo[78770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:01:52 devstack sudo[78770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:01:52 devstack sudo[78770]: pam_unix(sudo:session): session closed for user root Apr 01 08:01:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:01:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:01:52 devstack sudo[78777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:01:52 devstack sudo[78777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:01:53 devstack sudo[78777]: pam_unix(sudo:session): session closed for user root Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:01:53 devstack sudo[78780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:01:53 devstack sudo[78780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:01:53 devstack sudo[78780]: pam_unix(sudo:session): session closed for user root Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.422s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:01:53 devstack sudo[78788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:01:53 devstack sudo[78788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:01:53 devstack sudo[78788]: pam_unix(sudo:session): session closed for user root Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.394s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:01:53 devstack cinder-volume[72657]: DEBUG cinder.manager [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Notifying Schedulers of capabilities ... {{(pid=72657) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:02:19 devstack cinder-volume[72657]: DEBUG dbcounter [-] [72657] Writing DB stats cinder:SELECT=1 {{(pid=72657) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:02:19 devstack cinder-volume[72657]: DEBUG dbcounter [-] [72657] Writing DB stats cinder:UPDATE=1 {{(pid=72657) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:02:52 devstack cinder-volume[72657]: DEBUG oslo_service.periodic_task [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72657) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:02:52 devstack cinder-volume[72657]: DEBUG cinder.volume.drivers.lvm [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Updating volume stats {{(pid=72657) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 01 08:02:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:02:52 devstack sudo[80945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 01 08:02:52 devstack sudo[80945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:02:52 devstack sudo[80945]: pam_unix(sudo:session): session closed for user root Apr 01 08:02:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:02:52 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:02:52 devstack sudo[80950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:02:52 devstack sudo[80950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:02:53 devstack sudo[80950]: pam_unix(sudo:session): session closed for user root Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:02:53 devstack sudo[80963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 01 08:02:53 devstack sudo[80963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:02:53 devstack sudo[80963]: pam_unix(sudo:session): session closed for user root Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:02:53 devstack sudo[80969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 01 08:02:53 devstack sudo[80969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:02:53 devstack sudo[80969]: pam_unix(sudo:session): session closed for user root Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG oslo_concurrency.processutils [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:02:53 devstack cinder-volume[72657]: DEBUG cinder.manager [None req-cd419806-d124-4282-ba0d-513cad36d4cb None None] Notifying Schedulers of capabilities ... {{(pid=72657) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:03:16 devstack cinder-volume[72512]: INFO oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Caught SIGTERM, stopping children Apr 01 08:03:16 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Acquiring lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:16 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Acquired lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:16 devstack cinder-volume[72512]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Releasing lock "singleton_lock" {{(pid=72512) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:16 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Stop services. {{(pid=72512) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 01 08:03:16 devstack cinder-volume[72512]: DEBUG oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Killing children. {{(pid=72512) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 01 08:03:16 devstack cinder-volume[72512]: INFO oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Waiting on 1 children to exit Apr 01 08:03:17 devstack cinder-volume[72657]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Acquiring lock "singleton_lock" {{(pid=72657) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:17 devstack cinder-volume[72657]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Acquired lock "singleton_lock" {{(pid=72657) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:17 devstack cinder-volume[72657]: DEBUG oslo_concurrency.lockutils [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Releasing lock "singleton_lock" {{(pid=72657) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:17 devstack cinder-volume[72657]: WARNING amqp [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 01 08:03:17 devstack cinder-volume[72657]: WARNING amqp [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 01 08:03:17 devstack cinder-volume[72512]: INFO oslo_service.backend._eventlet.service [None req-535000b7-711c-46cf-837d-92707c95dd8b None None] Child 72657 exited with status 0 Apr 01 08:03:19 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:19 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:19 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:20 devstack cinder-volume[81585]: INFO dbcounter [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Registered counter for database cinder Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG dbcounter [-] [81585] Writer thread running {{(pid=81585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 08:03:20 devstack cinder-volume[81585]: INFO cinder.rpc [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 01 08:03:20 devstack cinder-volume[81585]: INFO cinder.rpc [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:20 devstack cinder-volume[81585]: INFO cinder.volume.manager [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Determined volume DB was empty at startup. Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG cinder.volume.manager [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81585) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 01 08:03:20 devstack cinder-volume[81585]: INFO cinder.volume.manager [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 01 08:03:20 devstack cinder-volume[81585]: WARNING stevedore.named [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 01 08:03:20 devstack cinder-volume[81585]: WARNING castellan.key_manager [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 08:03:20 devstack cinder-volume[81585]: WARNING cinder.keymgr.conf_key_mgr [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 08:03:20 devstack cinder-volume[81585]: INFO cinder.volume.manager [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:20 devstack cinder-volume[81585]: INFO oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Starting 1 workers Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Started child 81701 {{(pid=81585) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Full set of CONF: {{(pid=81585) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] ******************************************************************************** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Configuration options gathered from: {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] ================================================================================ {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] allow_availability_zone_fallback = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] allow_compression_on_image_upload = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] allowed_direct_url_schemes = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] api_rate_limit = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] auth_strategy = keystone {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_availability_zone = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_host = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_stats_polling_interval = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backup_api_class = cinder.backup.api.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backup_name_template = backup-%s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backup_use_same_host = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backup_use_temp_snapshot = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] chap_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] chap_username = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_internal_tenant_project_id = 8a934f7239d546aa855331b82cb18880 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_internal_tenant_user_id = 70b1144706954406b5979cc00e3f5ea4 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cluster = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] compression_format = gzip {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] compute_api_class = cinder.compute.nova.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81701]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] config_dir = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] config_source = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] control_exchange = openstack {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] debug = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] default_availability_zone = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] default_group_type = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] default_volume_type = QuobyteHD {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] disk_geometry = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_client_cert = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_client_cert_key = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_data_namespace = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_ssl_cert_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_ssl_cert_verify = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] driver_use_ssl = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] enable_new_services = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] enable_unsupported_driver = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] enabled_backends = ['QuobyteHD'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] enforce_multipath_for_image_xfer = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] filter_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_api_insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_api_ssl_compression = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_ca_certificates_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_catalog_info = image:glance:publicURL {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_num_retries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance_request_timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] goodness_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] graceful_shutdown_timeout = 5 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] group_api_class = cinder.group.api.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] host = devstack {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_compress_on_upload = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_conversion_address_space_limit = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_conversion_cpu_limit = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_conversion_disable = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_upload_use_cinder_backend = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_upload_use_internal_tenant = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_volume_cache_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_volume_cache_max_count = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] image_volume_cache_max_size_gb = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] init_host_max_objects_retrieval = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] instance_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iscsi_target_flags = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iscsi_write_cache = on {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iser_helper = tgtadm {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iser_ip_address = 192.168.122.46 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iser_port = 3260 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_color = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.remotefs [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81701) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_config_append = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_dir = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_options = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_rotate_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_rotate_interval_type = days {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] log_rotation_type = none {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] max_age = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] max_logfile_count = 30 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] max_logfile_size_mb = 200 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] max_over_subscription_ratio = 20.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] message_reap_interval = 86400 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] message_ttl = 2592000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] migration_create_volume_timeout_secs = 300 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] monkey_patch = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] monkey_patch_modules = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] my_ip = 192.168.122.46 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] no_snapshot_gb_quota = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] num_iser_scan_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] num_shell_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] num_volume_device_scan_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] nvmeof_conn_info_version = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] nvmet_ns_id = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] nvmet_port_id = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_max_limit = 1000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_ext_list = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_listen = 0.0.0.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_listen_port = 8776 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_use_ssl = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] osapi_volume_workers = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] per_volume_size_limit = -1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] periodic_fuzzy_delay = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] periodic_interval = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] project_id_regex = [0-9a-f\-]+ {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] public_endpoint = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] publish_errors = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_backup_gigabytes = 1000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_backups = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_gigabytes = 1000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_groups = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_snapshots = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] quota_volumes = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] rate_limit_burst = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] rate_limit_except_level = CRITICAL {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] rate_limit_interval = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] reinit_driver_count = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] replication_device = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] report_discard_supported = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] report_interval = 120 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] reservation_clean_interval = 86400 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] reservation_expire = 86400 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] reserved_image_namespaces = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] reserved_percentage = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] rpc_response_timeout = 120 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] run_external_periodic_tasks = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] scst_target_driver = iscsi {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] scst_target_iqn_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_down_time = 720 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] shell_completion = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] snapshot_name_template = snapshot-%s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] split_loggers = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] state_path = /opt/stack/data/cinder {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] storage_availability_zone = nova {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] storage_protocol = iSCSI {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] syslog_log_facility = LOG_USER {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_helper = lioadm {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_ip_address = 192.168.122.46 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_port = 3260 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_protocol = iscsi {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] target_secondary_ip_addresses = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] trace_flags = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] transfer_api_class = cinder.transfer.api.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] transport_url = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] until_refresh = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_chap_auth = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_default_quota_class = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_journal = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_json = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_multipath_for_image_xfer = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_stderr = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] use_syslog = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] verify_glance_signatures = enabled {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_api_class = cinder.volume.api.API {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_backend_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_clear = zero {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_clear_ionice = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_clear_size = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_copy_bps_limit = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_dd_blocksize = 1M {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_name_template = volume-%s {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_service_inithost_offload = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volume_usage_audit_period = month {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] zoning_mode = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_concurrency.disable_process_locking = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.admin_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.admin_token = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.admin_user = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_admin_prefix = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_port = 35357 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_protocol = https {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_section = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_type = password {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_uri = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.auth_version = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81701) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 01 08:03:20 devstack cinder-volume[81701]: WARNING cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 01 08:03:20 devstack cinder-volume[81701]: WARNING cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.cache = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Running cmd (subprocess): mount.quobyte {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.delay_auth_decision = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.http_connect_timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.identity_uri = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.include_service_catalog = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.interface = public {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_password = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcache_username = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.region_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.service_token_roles_required = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.service_type = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.token_cache_time = 300 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.backend = dogpile.cache.null {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.backend_argument = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.backend_expiration_time = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.config_prefix = cache.oslo {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.debug_cache_backend = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.enable_retry_client = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.enable_socket_keepalive = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.enforce_fips_mode = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.expiration_time = 600 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.hashclient_retry_attempts = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_dead_retry = 300 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_sasl_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.proxies = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.redis_db = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.redis_sentinel_service_name = mymaster {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.redis_server = localhost:6379 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.retry_attempts = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.retry_delay = 0.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.socket_keepalive_count = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.socket_keepalive_idle = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.socket_keepalive_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.socket_timeout = 1.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.tls_allowed_ciphers = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.tls_cafile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.tls_certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.tls_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.tls_keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cache.username = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] coordination.backend_url = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.asyncio_connection = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.asyncio_slave_connection = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.backend = sqlalchemy {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.connection = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.connection_debug = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.connection_parameters = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.connection_recycle_time = 3600 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.connection_trace = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.db_inc_retry_interval = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.db_max_retries = 20 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.db_max_retry_interval = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.db_retry_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.max_overflow = 50 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.max_pool_size = 5 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.max_retries = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.mysql_wsrep_sync_wait = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.pool_timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.retry_interval = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.slave_connection = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.sqlite_synchronous = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.synchronous_reader = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] database.use_db_reconnect = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.connection_string = messaging:// {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.es_doc_type = notification {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.es_scroll_size = 10000 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.es_scroll_time = 2m {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.filter_error_trace = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.hmac_keys = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.sentinel_service_name = mymaster {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.socket_timeout = 0.1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.trace_requests = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler.trace_sqlalchemy = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler_jaeger.process_tags = {} {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler_jaeger.service_name_prefix = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] profiler_otlp.service_name_prefix = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.enforce_new_defaults = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: WARNING oslo_config.cfg [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.enforce_scope = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.policy_default_rule = default {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.policy_file = policy.yaml {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_policy.remote_timeout = 60.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.group = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.helper_command = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] privsep_osbrick.user = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.group = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.helper_command = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] cinder_sys_admin.user = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.auth_section = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.auth_type = password {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.cafile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack quobyte-client[81705]: Reading configuration file: /etc/quobyte/client.cfg Apr 01 08:03:20 devstack quobyte-client[81705]: Invalid parameters found, error: missing mount point. Apr 01 08:03:20 devstack quobyte-client[81705]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 01 08:03:20 devstack quobyte-client[81705]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.collect_timing = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.send_service_user_token = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.split_loggers = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] service_user.timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.auth_section = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.auth_type = password {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.collect_timing = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.region_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.split_loggers = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] glance.timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.backend_availability_zone = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.chap_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.chap_username = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.disk_geometry = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_client_cert = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_client_cert_key = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_data_namespace = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.driver_use_ssl = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.enable_unsupported_driver = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.extra_capabilities = {} {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=81701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.filter_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.goodness_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: INFO cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 ... Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba -c /etc/quobyte/client-cinder.cfg {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iscsi_target_flags = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iscsi_write_cache = on {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iser_helper = tgtadm {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iser_port = 3260 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_host = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_login = admin {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_mount_options = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_private_key = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_share_path = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_ssh_port = 22 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.num_shell_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.nvmet_port_id = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_client_cfg = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.quobyte_volume_url = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.replication_device = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.report_discard_supported = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.reserved_percentage = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack sudo[81706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba -c /etc/quobyte/client-cinder.cfg Apr 01 08:03:20 devstack sudo[81706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.scst_target_driver = iscsi {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.scst_target_iqn_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.storage_protocol = iSCSI {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_helper = tgtadm {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_port = 3260 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_protocol = iscsi {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.trace_flags = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.unique_fqdn_network = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.use_chap_auth = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_backend_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_clear = zero {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_clear_ionice = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_clear_size = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_reports.file_event_handler = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_reports.log_dir = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.backend_availability_zone = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.backend_host = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.chap_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.chap_username = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.chiscsi_conf = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.disk_geometry = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_client_cert = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_client_cert_key = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_data_namespace = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.driver_use_ssl = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.extra_capabilities = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.filter_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.goodness_function = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iscsi_target_flags = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iscsi_write_cache = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iser_helper = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iser_ip_address = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iser_port = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.iser_target_prefix = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_host = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_login = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_mount_options = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_password = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_private_key = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_share_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_ssh_port = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.num_shell_tries = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nvmet_ns_id = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.nvmet_port_id = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.replication_device = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.report_discard_supported = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.reserved_percentage = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.scst_target_driver = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.storage_protocol = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_helper = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_ip_address = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_port = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_prefix = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_protocol = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.trace_flags = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.unique_fqdn_network = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.use_chap_auth = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_clear = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_clear_ionice = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_clear_size = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] QuobyteHD.volumes_dir = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.ssl_version = {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_notifications.driver = [] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_notifications.retry = -1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] key_manager.fixed_key = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.barbican_api_version = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.barbican_endpoint = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.barbican_endpoint_type = public {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.barbican_region_name = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.cafile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.collect_timing = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.number_of_retries = 60 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.retry_delay = 1 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.send_service_user_token = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.split_loggers = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.verify_ssl = True {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican.verify_ssl_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.auth_section = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.auth_type = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.cafile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.certfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.collect_timing = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.insecure = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.keyfile = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.split_loggers = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] barbican_service_user.timeout = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.approle_role_id = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.approle_secret_id = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.kv_mountpoint = secret {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.kv_path = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.kv_version = 2 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.namespace = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.root_token_id = **** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.ssl_ca_crt_file = None {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.timeout = 60.0 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.use_ssl = False {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:20 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] ******************************************************************************** {{(pid=81585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 01 08:03:21 devstack sudo[81706]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.493s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 succeeded Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=81701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.499s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:21 devstack sudo[81776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:21 devstack sudo[81776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:21 devstack sudo[81776]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.363s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.volume.driver [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Driver hasn't implemented _init_vendor_properties() Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.volume.driver [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7467346191406, 'free_capacity_gb': 1775.7467346191406, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81701) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG dbcounter [-] [81701] Writer thread running {{(pid=81701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.db.sqlalchemy.api [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Building query based on filter {{(pid=81701) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.image.image_utils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81701) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.keymgr.migration [None req-0d409944-0049-4426-a430-fb1da9cd4afd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=81701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=81701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:21 devstack sudo[81780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:21 devstack sudo[81780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:21 devstack sudo[81780]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.367s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Notifying Schedulers of capabilities ... {{(pid=81701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Driver initialization completed successfully. Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Initiating service 3 cleanup Apr 01 08:03:21 devstack cinder-volume[81701]: INFO cinder.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Service 3 cleanup completed. Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.service [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Creating RPC server for service cinder-volume {{(pid=81701) start /opt/stack/cinder/cinder/service.py:231}} Apr 01 08:03:21 devstack cinder-volume[81701]: DEBUG cinder.service [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81701) start /opt/stack/cinder/cinder/service.py:237}} Apr 01 08:03:22 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=81701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=81701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:22 devstack sudo[81784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:22 devstack sudo[81784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:22 devstack sudo[81784]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:22 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.426s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:22 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-d9d51f50-2346-4480-bc73-b12e5215a2f9 None None] Driver post RPC initialization completed successfully. Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=81701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG cinder.volume.drivers.quobyte [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=81701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:25 devstack cinder-volume[81585]: INFO oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Caught SIGTERM, stopping children Apr 01 08:03:25 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Acquiring lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:25 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Acquired lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:25 devstack cinder-volume[81585]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Releasing lock "singleton_lock" {{(pid=81585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:25 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Stop services. {{(pid=81585) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 01 08:03:25 devstack cinder-volume[81585]: DEBUG oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Killing children. {{(pid=81585) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 01 08:03:25 devstack cinder-volume[81585]: INFO oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Waiting on 1 children to exit Apr 01 08:03:25 devstack sudo[81919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:25 devstack sudo[81919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:25 devstack sudo[81919]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG oslo_concurrency.processutils [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.746s {{(pid=81701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:25 devstack cinder-volume[81701]: DEBUG cinder.manager [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Notifying Schedulers of capabilities ... {{(pid=81701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Unable to connect to AMQP server on 192.168.122.46:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server [None req-6d8f7cbd-a4fa-487a-8ba7-e8b679ed4060 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.46:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server method() Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return _publish( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server listener(*args) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.46:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 01 08:03:25 devstack cinder-volume[81701]: ERROR oslo_messaging.rpc.server Apr 01 08:03:26 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Acquiring lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:26 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Acquired lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:26 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Releasing lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:26 devstack cinder-volume[81701]: WARNING amqp [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 01 08:03:26 devstack cinder-volume[81701]: WARNING amqp [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 01 08:03:26 devstack cinder-volume[81585]: INFO oslo_service.backend._eventlet.service [None req-eca50c39-416b-426e-9f12-3816e119ce6e None None] Child 81701 exited with status 0 Apr 01 08:03:27 devstack cinder-volume[81923]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81923) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 01 08:03:27 devstack cinder-volume[81923]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81923) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 01 08:03:27 devstack cinder-volume[81923]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81923) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 01 08:03:28 devstack cinder-volume[81923]: INFO dbcounter [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Registered counter for database cinder Apr 01 08:03:28 devstack cinder-volume[81923]: DEBUG oslo_db.sqlalchemy.engines [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:28 devstack cinder-volume[81923]: DEBUG dbcounter [-] [81923] Writer thread running {{(pid=81923) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 08:03:28 devstack cinder-volume[81923]: INFO cinder.rpc [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 01 08:03:28 devstack cinder-volume[81923]: INFO cinder.rpc [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 01 08:03:28 devstack cinder-volume[81923]: DEBUG oslo_db.sqlalchemy.engines [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:28 devstack cinder-volume[81923]: INFO cinder.volume.manager [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Determined volume DB was empty at startup. Apr 01 08:03:28 devstack cinder-volume[81923]: DEBUG cinder.volume.manager [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81923) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 01 08:03:28 devstack cinder-volume[81923]: WARNING stevedore.named [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 01 08:03:28 devstack cinder-volume[81923]: WARNING castellan.key_manager [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 08:03:28 devstack cinder-volume[81923]: WARNING cinder.keymgr.conf_key_mgr [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 01 08:03:28 devstack cinder-volume[81923]: INFO cinder.volume.manager [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 01 08:03:28 devstack cinder-volume[81923]: DEBUG oslo_db.sqlalchemy.engines [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:29 devstack cinder-volume[81923]: INFO oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Starting 1 workers Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Started child 82084 {{(pid=81923) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Full set of CONF: {{(pid=81923) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] ******************************************************************************** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Configuration options gathered from: {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] ================================================================================ {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] allow_availability_zone_fallback = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] allow_compression_on_image_upload = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] allowed_direct_url_schemes = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[82084]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] api_rate_limit = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] auth_strategy = keystone {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_availability_zone = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_host = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_stats_polling_interval = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backup_api_class = cinder.backup.api.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backup_name_template = backup-%s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backup_use_same_host = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backup_use_temp_snapshot = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] chap_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] chap_username = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_internal_tenant_project_id = 8a934f7239d546aa855331b82cb18880 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_internal_tenant_user_id = 70b1144706954406b5979cc00e3f5ea4 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cluster = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] compression_format = gzip {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] compute_api_class = cinder.compute.nova.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] config_dir = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] config_source = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] control_exchange = openstack {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] debug = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] default_availability_zone = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] default_group_type = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] default_volume_type = QuobyteHD {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] disk_geometry = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_client_cert = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_client_cert_key = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_data_namespace = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_ssl_cert_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_ssl_cert_verify = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] driver_use_ssl = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] enable_new_services = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] enable_unsupported_driver = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] enabled_backends = ['QuobyteHD'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] enforce_multipath_for_image_xfer = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] filter_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_api_insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_api_ssl_compression = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_ca_certificates_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_catalog_info = image:glance:publicURL {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_num_retries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance_request_timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] goodness_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] graceful_shutdown_timeout = 5 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] group_api_class = cinder.group.api.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] host = devstack {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_compress_on_upload = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_conversion_address_space_limit = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_conversion_cpu_limit = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_conversion_disable = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_upload_use_cinder_backend = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_upload_use_internal_tenant = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_volume_cache_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_volume_cache_max_count = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] image_volume_cache_max_size_gb = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] init_host_max_objects_retrieval = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] instance_format = [instance: %(uuid)s] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iscsi_target_flags = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iscsi_write_cache = on {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iser_helper = tgtadm {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iser_ip_address = 192.168.122.46 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iser_port = 3260 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_color = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_config_append = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82084) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_dir = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_options = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_rotate_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_rotate_interval_type = days {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] log_rotation_type = none {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] max_age = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] max_logfile_count = 30 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] max_logfile_size_mb = 200 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] max_over_subscription_ratio = 20.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] message_reap_interval = 86400 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] message_ttl = 2592000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] migration_create_volume_timeout_secs = 300 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] monkey_patch = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] monkey_patch_modules = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] my_ip = 192.168.122.46 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] no_snapshot_gb_quota = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] num_iser_scan_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] num_shell_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] num_volume_device_scan_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] nvmeof_conn_info_version = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] nvmet_ns_id = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] nvmet_port_id = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_max_limit = 1000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_ext_list = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_listen_port = 8776 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_use_ssl = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] osapi_volume_workers = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] per_volume_size_limit = -1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] periodic_fuzzy_delay = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] periodic_interval = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] public_endpoint = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] publish_errors = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_backup_gigabytes = 1000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_backups = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_gigabytes = 1000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_groups = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_snapshots = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] quota_volumes = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] rate_limit_burst = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] rate_limit_except_level = CRITICAL {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] rate_limit_interval = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] reinit_driver_count = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] replication_device = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] report_discard_supported = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] report_interval = 120 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] reservation_clean_interval = 86400 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] reservation_expire = 86400 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] reserved_image_namespaces = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] reserved_percentage = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] rpc_response_timeout = 120 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] run_external_periodic_tasks = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] scst_target_driver = iscsi {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] scst_target_iqn_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_down_time = 720 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] shell_completion = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] snapshot_name_template = snapshot-%s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] split_loggers = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] state_path = /opt/stack/data/cinder {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] storage_availability_zone = nova {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] storage_protocol = iSCSI {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] syslog_log_facility = LOG_USER {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_helper = lioadm {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_ip_address = 192.168.122.46 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_port = 3260 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_protocol = iscsi {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] target_secondary_ip_addresses = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] trace_flags = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] transport_url = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] until_refresh = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_chap_auth = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_default_quota_class = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_journal = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_json = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_multipath_for_image_xfer = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_stderr = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] use_syslog = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] verify_glance_signatures = enabled {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_api_class = cinder.volume.api.API {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_backend_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_clear = zero {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_clear_ionice = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_clear_size = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_copy_bps_limit = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_dd_blocksize = 1M {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_name_template = volume-%s {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_service_inithost_offload = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volume_usage_audit_period = month {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] zoning_mode = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_concurrency.disable_process_locking = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.admin_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.admin_token = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.admin_user = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_port = 35357 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_protocol = https {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_section = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_type = password {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_uri = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.auth_version = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.cache = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.identity_uri = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.include_service_catalog = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.interface = public {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_password = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcache_username = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.region_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.service_type = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.backend = dogpile.cache.null {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.backend_argument = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.backend_expiration_time = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.config_prefix = cache.oslo {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.debug_cache_backend = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.enable_retry_client = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.enable_socket_keepalive = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.enforce_fips_mode = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.expiration_time = 600 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.hashclient_retry_attempts = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_dead_retry = 300 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_pool_maxsize = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_sasl_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.proxies = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.redis_db = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.redis_server = localhost:6379 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.retry_attempts = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.retry_delay = 0.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.socket_keepalive_count = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.socket_keepalive_idle = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.socket_keepalive_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.socket_timeout = 1.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.tls_allowed_ciphers = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.tls_cafile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.tls_certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.tls_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.tls_keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cache.username = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] coordination.backend_url = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.asyncio_connection = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.asyncio_slave_connection = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.backend = sqlalchemy {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.connection = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.connection_debug = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.connection_parameters = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.connection_recycle_time = 3600 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.connection_trace = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.db_inc_retry_interval = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.db_max_retries = 20 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.db_max_retry_interval = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.db_retry_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.max_overflow = 50 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.max_pool_size = 5 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.max_retries = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.mysql_wsrep_sync_wait = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.pool_timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.retry_interval = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.slave_connection = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.sqlite_synchronous = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.synchronous_reader = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] database.use_db_reconnect = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.connection_string = messaging:// {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.es_doc_type = notification {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.es_scroll_size = 10000 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.es_scroll_time = 2m {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.filter_error_trace = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.hmac_keys = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.sentinel_service_name = mymaster {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.socket_timeout = 0.1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.trace_requests = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler.trace_sqlalchemy = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler_jaeger.process_tags = {} {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler_jaeger.service_name_prefix = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] profiler_otlp.service_name_prefix = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.enforce_new_defaults = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: WARNING oslo_config.cfg [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.enforce_scope = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.policy_default_rule = default {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.policy_file = policy.yaml {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.group = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.helper_command = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] privsep_osbrick.user = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.group = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.helper_command = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] cinder_sys_admin.user = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.auth_section = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.auth_type = password {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.cafile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.collect_timing = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.send_service_user_token = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.split_loggers = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] service_user.timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.auth_section = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.auth_type = password {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.collect_timing = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.region_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.split_loggers = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] glance.timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.backend_availability_zone = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.chap_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.chap_username = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.disk_geometry = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_client_cert = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_client_cert_key = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_data_namespace = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.driver_use_ssl = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.extra_capabilities = {} {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.filter_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.goodness_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iscsi_target_flags = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iscsi_write_cache = on {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iser_helper = tgtadm {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iser_port = 3260 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_host = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_login = admin {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_mount_options = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_private_key = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_share_path = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.num_shell_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.quobyte_volume_url = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.replication_device = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.report_discard_supported = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.reserved_percentage = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_helper = tgtadm {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_port = 3260 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_protocol = iscsi {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.trace_flags = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.unique_fqdn_network = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.use_chap_auth = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_backend_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_clear = zero {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_clear_ionice = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_clear_size = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_reports.file_event_handler = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_reports.log_dir = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.backend_availability_zone = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.backend_host = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.chap_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.chap_username = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.chiscsi_conf = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.disk_geometry = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_client_cert = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_data_namespace = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.driver_use_ssl = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.extra_capabilities = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.filter_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.goodness_function = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iser_helper = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iser_ip_address = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iser_port = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.iser_target_prefix = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_host = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_login = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_mount_options = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_password = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_private_key = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_share_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_ssh_port = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.num_shell_tries = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.nvmet_port_id = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.replication_device = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.report_discard_supported = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.reserved_percentage = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.scst_target_driver = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.storage_protocol = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_helper = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_ip_address = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_port = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_prefix = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_protocol = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.trace_flags = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.use_chap_auth = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_clear = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_clear_size = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] QuobyteHD.volumes_dir = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_notifications.driver = [] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_notifications.retry = -1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] key_manager.fixed_key = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.barbican_api_version = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.barbican_endpoint = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.barbican_endpoint_type = public {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.barbican_region_name = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.cafile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.collect_timing = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.number_of_retries = 60 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.retry_delay = 1 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.send_service_user_token = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.split_loggers = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.verify_ssl = True {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican.verify_ssl_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.auth_section = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.auth_type = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.cafile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.certfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82084) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.collect_timing = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.insecure = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.keyfile = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.split_loggers = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] barbican_service_user.timeout = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.approle_role_id = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.approle_secret_id = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.kv_mountpoint = secret {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.kv_path = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.kv_version = 2 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.namespace = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.root_token_id = **** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.ssl_ca_crt_file = None {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.timeout = 60.0 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.use_ssl = False {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 01 08:03:29 devstack cinder-volume[81923]: DEBUG oslo_service.backend._eventlet.service [None req-ad7fc123-59d1-41c2-bd5b-d54a58072909 None None] ******************************************************************************** {{(pid=81923) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Running cmd (subprocess): mount.quobyte {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:29 devstack quobyte-client[82104]: Reading configuration file: /etc/quobyte/client.cfg Apr 01 08:03:29 devstack quobyte-client[82104]: Invalid parameters found, error: missing mount point. Apr 01 08:03:29 devstack quobyte-client[82104]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 01 08:03:29 devstack quobyte-client[82104]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:29 devstack sudo[82106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:29 devstack sudo[82106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:29 devstack sudo[82106]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.391s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:29 devstack cinder-volume[82084]: INFO cinder.volume.driver [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Driver hasn't implemented _init_vendor_properties() Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.driver [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7029914855957, 'free_capacity_gb': 1775.7029914855957, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82084) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_db.sqlalchemy.engines [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writer thread running {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.db.sqlalchemy.api [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Building query based on filter {{(pid=82084) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82084) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:29 devstack cinder-volume[82084]: INFO cinder.keymgr.migration [None req-11e900f3-7b7a-4c79-a593-eca5e084bab9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 01 08:03:29 devstack sudo[82114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:29 devstack sudo[82114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:30 devstack sudo[82114]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.397s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:03:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Driver initialization completed successfully. Apr 01 08:03:30 devstack cinder-volume[82084]: INFO cinder.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Initiating service 3 cleanup Apr 01 08:03:30 devstack cinder-volume[82084]: INFO cinder.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Service 3 cleanup completed. Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG cinder.service [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Creating RPC server for service cinder-volume {{(pid=82084) start /opt/stack/cinder/cinder/service.py:231}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG cinder.service [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82084) start /opt/stack/cinder/cinder/service.py:237}} Apr 01 08:03:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:03:30 devstack sudo[82146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:03:30 devstack sudo[82146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:03:30 devstack sudo[82146]: pam_unix(sudo:session): session closed for user root Apr 01 08:03:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.358s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:03:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-333bd4c7-fc48-4bda-8e39-a306ed0aaf21 None None] Driver post RPC initialization completed successfully. Apr 01 08:03:39 devstack cinder-volume[81923]: DEBUG dbcounter [-] [81923] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81923) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:03:40 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:03:40 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=2 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Flow 'volume_create_manager' (84a81808-5038-45c8-9692-f69ef245dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952ca22-67c0-4344-98ff-9b466186ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952ca22-67c0-4344-98ff-9b466186ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1266758538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93d7247-8ddf-4998-9664-0d69a0136c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d2706129b14612a5fb4de35fbc29a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='925d35c96e294f0b8223f6ac61ab97cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d7ba7-302d-4b99-8eb0-8fd25a6345d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d7ba7-302d-4b99-8eb0-8fd25a6345d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d96d9c-f64c-4b57-8298-c259a418e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d96d9c-f64c-4b57-8298-c259a418e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93d7247-8ddf-4998-9664-0d69a0136c21', 'volume_name': 'volume-c93d7247-8ddf-4998-9664-0d69a0136c21', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2de73c-51df-4c29-9d30-7a8d1770ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2de73c-51df-4c29-9d30-7a8d1770ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa45635-bb08-4c94-b37c-585fa0a510bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:29 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Volume c93d7247-8ddf-4998-9664-0d69a0136c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93d7247-8ddf-4998-9664-0d69a0136c21', 'volume_size': 1} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1266758538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93d7247-8ddf-4998-9664-0d69a0136c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d2706129b14612a5fb4de35fbc29a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='925d35c96e294f0b8223f6ac61ab97cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Creating volume c93d7247-8ddf-4998-9664-0d69a0136c21 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:30 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Flow 'volume_create_manager' (c8a7886e-1ba0-4617-9d11-617a6f550579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:30 devstack sudo[82579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 1073741824 Apr 01 08:04:30 devstack sudo[82579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96863927-8512-49f8-b8f4-040ce2274baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96863927-8512-49f8-b8f4-040ce2274baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2119657256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac0fb2-6c2a-4b87-93ad-c071b0602392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d46cdd937d740b6b7965d7fdbb4c616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='f1106392248942cd9c347c1e3feb5dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479cc013-6e48-4d20-88d8-da6605e7df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479cc013-6e48-4d20-88d8-da6605e7df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6551a729-5be6-4fef-b5c4-5d8c3df4587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6551a729-5be6-4fef-b5c4-5d8c3df4587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaac0fb2-6c2a-4b87-93ad-c071b0602392', 'volume_name': 'volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9124d11-895b-46d4-ada6-9633a2ea4f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9124d11-895b-46d4-ada6-9633a2ea4f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdbfb5c-50e4-48a7-b3aa-9426e1fde084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Volume eaac0fb2-6c2a-4b87-93ad-c071b0602392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392', 'volume_size': 1} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Flow 'volume_create_manager' (281a6913-6fbc-4075-af25-8a84b5218463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ebaecd-7d77-4dcb-ace7-455c4795dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ebaecd-7d77-4dcb-ace7-455c4795dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-104736566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d1ae2a-21c2-422a-8524-e6e453a4d9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65888cccc2304b1391461251b143d64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='0464ab5feec04e269e81bd5b74c7520a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10312320-cc58-4369-99c1-81cf545961cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10312320-cc58-4369-99c1-81cf545961cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a46636-cb83-4013-80ce-24406fe34b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a46636-cb83-4013-80ce-24406fe34b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d1ae2a-21c2-422a-8524-e6e453a4d9a4', 'volume_name': 'volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13ab975-992a-48ab-acf2-c7424cda5af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13ab975-992a-48ab-acf2-c7424cda5af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80bce5-4161-4f38-aad4-d2ad833e9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Volume 59d1ae2a-21c2-422a-8524-e6e453a4d9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4', 'volume_size': 1} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Flow 'volume_create_manager' (f7e6f155-8d52-47fd-8020-121e454a8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d457b4c2-7ba3-41c1-841d-a01a56dcb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d457b4c2-7ba3-41c1-841d-a01a56dcb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-616694316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03196f-454f-4cc5-8d0d-c44ac53b7c18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e33095b3f2f476885030ac03ee47b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='0fe64221bf084a6d98c258531f4359e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dec343-8fb0-4129-bb83-d40dbf953e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dec343-8fb0-4129-bb83-d40dbf953e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd332c44-9507-4bb7-a284-d7f04cb78485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd332c44-9507-4bb7-a284-d7f04cb78485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e03196f-454f-4cc5-8d0d-c44ac53b7c18', 'volume_name': 'volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb9bc2-1825-4bd4-8e1d-f900d81c6437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb9bc2-1825-4bd4-8e1d-f900d81c6437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd688f-f2bb-4a4a-ad2d-e37898bc1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Volume 6e03196f-454f-4cc5-8d0d-c44ac53b7c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18', 'volume_size': 1} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:30 devstack sudo[82579]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 1073741824" returned: 0 in 0.638s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:30 devstack sudo[82899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 Apr 01 08:04:30 devstack sudo[82899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:31 devstack sudo[82899]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21" returned: 0 in 0.482s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2119657256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaac0fb2-6c2a-4b87-93ad-c071b0602392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d46cdd937d740b6b7965d7fdbb4c616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='f1106392248942cd9c347c1e3feb5dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Creating volume eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:31 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa45635-bb08-4c94-b37c-585fa0a510bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93d7247-8ddf-4998-9664-0d69a0136c21', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6933d1da-f94f-4d39-aef9-9d0c617d4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:31 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 1073741824 Apr 01 08:04:31 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:31 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Volume volume-c93d7247-8ddf-4998-9664-0d69a0136c21 (c93d7247-8ddf-4998-9664-0d69a0136c21): created successfully Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6933d1da-f94f-4d39-aef9-9d0c617d4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Flow 'volume_create_manager' (84a81808-5038-45c8-9692-f69ef245dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:31 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-53acaeda-0d10-4c95-808c-b6c5fabc2bd3 tempest-DeleteServersTestJSON-266002736 None] Created volume successfully. Apr 01 08:04:31 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 1073741824" returned: 0 in 0.584s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:31 devstack sudo[82919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 Apr 01 08:04:31 devstack sudo[82919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:32 devstack sudo[82919]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392" returned: 0 in 0.397s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-104736566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d1ae2a-21c2-422a-8524-e6e453a4d9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65888cccc2304b1391461251b143d64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='0464ab5feec04e269e81bd5b74c7520a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Creating volume 59d1ae2a-21c2-422a-8524-e6e453a4d9a4 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:32 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdbfb5c-50e4-48a7-b3aa-9426e1fde084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466430c6-3b5f-4659-96cb-0052fffd9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:32 devstack sudo[82923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 1073741824 Apr 01 08:04:32 devstack sudo[82923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:32 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Volume volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 (eaac0fb2-6c2a-4b87-93ad-c071b0602392): created successfully Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466430c6-3b5f-4659-96cb-0052fffd9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Flow 'volume_create_manager' (c8a7886e-1ba0-4617-9d11-617a6f550579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-6420ff80-fd4e-43d4-8490-101146567ba0 req-9db18c48-6892-4341-9531-928048263d10 tempest-VolumesSnapshotsTestJSON-109028945 None] Created volume successfully. Apr 01 08:04:32 devstack sudo[82923]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 1073741824" returned: 0 in 0.505s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:32 devstack sudo[82929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 Apr 01 08:04:32 devstack sudo[82929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:33 devstack sudo[82929]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-616694316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03196f-454f-4cc5-8d0d-c44ac53b7c18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e33095b3f2f476885030ac03ee47b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:30Z,use_quota=True,user_id='0fe64221bf084a6d98c258531f4359e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Creating volume 6e03196f-454f-4cc5-8d0d-c44ac53b7c18 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:33 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80bce5-4161-4f38-aad4-d2ad833e9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0310aece-2591-43c6-93cc-5482aab509f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:33 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Volume volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 (59d1ae2a-21c2-422a-8524-e6e453a4d9a4): created successfully Apr 01 08:04:33 devstack sudo[82932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 1073741824 Apr 01 08:04:33 devstack sudo[82932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0310aece-2591-43c6-93cc-5482aab509f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Flow 'volume_create_manager' (281a6913-6fbc-4075-af25-8a84b5218463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:33 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-252e1c3f-c13c-4d60-bb5c-219fb75bae42 tempest-VolumesAdminNegativeTest-31285208 None] Created volume successfully. Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:33 devstack sudo[82932]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 1073741824" returned: 0 in 0.801s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:34 devstack sudo[82938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 Apr 01 08:04:34 devstack sudo[82938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Acquiring lock "cinder-59d1ae2a-21c2-422a-8524-e6e453a4d9a4-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "cinder-59d1ae2a-21c2-422a-8524-e6e453a4d9a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Acquiring lock "cinder-quobyte-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "cinder-quobyte-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:34 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3m1yvwbf/privsep.sock'] Apr 01 08:04:34 devstack sudo[82941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3m1yvwbf/privsep.sock Apr 01 08:04:34 devstack sudo[82941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:34 devstack sudo[82938]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" returned: 0 in 0.758s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.172s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Creating offline snapshot 3a1eab11-a791-4ea4-9dc1-379405a1999c of volume eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd688f-f2bb-4a4a-ad2d-e37898bc1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77783522-bc3d-4265-8b4d-8ec585964c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:34 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Volume volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 (6e03196f-454f-4cc5-8d0d-c44ac53b7c18): created successfully Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77783522-bc3d-4265-8b4d-8ec585964c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Flow 'volume_create_manager' (f7e6f155-8d52-47fd-8020-121e454a8605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-8d94666f-ae0f-4db1-b66a-cb84329e35c1 req-e776c69b-04c8-4e29-84d3-cdd524e65e6a tempest-VolumesGetTestJSON-1985742221 None] Created volume successfully. Apr 01 08:04:35 devstack sudo[82941]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:35 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Spawned new privsep daemon via rootwrap Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Accepted privsep connection to /tmp/tmp3m1yvwbf/privsep.sock {{(pid=82084) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 01 08:04:35 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 01 08:04:35 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 01 08:04:35 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 01 08:04:35 devstack cinder-volume[82084]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82962 Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16f786-a0ee-4625-bef7-af9253a8d99d]: (2,) {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:35 devstack cinder-volume[82084]: WARNING oslo_privsep.priv_context [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] privsep daemon already running Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80bd8bf-9f0c-4036-8fb2-87110a7ae4ec]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4721c6-f52e-45e7-a682-39a5a40dca79]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:35 devstack sudo[82966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 Apr 01 08:04:35 devstack sudo[82966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:35 devstack sudo[82965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 Apr 01 08:04:35 devstack sudo[82965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Acquiring lock "cinder-6e03196f-454f-4cc5-8d0d-c44ac53b7c18-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "cinder-6e03196f-454f-4cc5-8d0d-c44ac53b7c18-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Acquiring lock "cinder-quobyte-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "cinder-quobyte-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[09046f89-5228-4579-b2c4-d66badc1eafa]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:35 devstack sudo[82969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 Apr 01 08:04:35 devstack sudo[82969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:36 devstack sudo[82965]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" returned: 0 in 1.016s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:36 devstack sudo[82969]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" returned: 0 in 0.643s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:36 devstack sudo[82990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4 Apr 01 08:04:36 devstack sudo[82990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:36 devstack sudo[82966]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392" returned: 0 in 1.045s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:36 devstack sudo[82991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18 Apr 01 08:04:36 devstack sudo[82991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:36 devstack sudo[82994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c 1G Apr 01 08:04:36 devstack sudo[82994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:37 devstack sudo[82990]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" returned: 0 in 0.626s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "cinder-quobyte-59d1ae2a-21c2-422a-8524-e6e453a4d9a4" released by "delete_volume" :: held 2.814s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:37 devstack sudo[82991]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" returned: 0 in 0.668s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "cinder-quobyte-6e03196f-454f-4cc5-8d0d-c44ac53b7c18" released by "delete_volume" :: held 1.342s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:37 devstack cinder-volume[82084]: WARNING cinder.quota [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:04:37 devstack cinder-volume[82084]: WARNING cinder.quota [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Created reservations ['1c5ac31a-95e8-43dd-bbca-d4fea6f9b12e', 'e4d7a2f8-861e-4b7d-b6c5-12fd6a6c0e29', 'b07634d7-b421-4707-afd7-580b7293db82', 'a29223d3-4685-413b-be5f-86d23aee8575'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.quota [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Created reservations ['c704c3df-6706-4b18-b4ed-e0fee58e3113', 'e048c4b6-a502-472b-9522-9607f08188a4', '6796e196-5b67-4a80-b8d1-83e2afbc0931', 'bfe12dc5-1394-45fa-bb55-75fd0edd29d5'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:37 devstack sudo[83011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:37 devstack sudo[83011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:37 devstack sudo[82994]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:37 devstack sudo[83014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:37 devstack sudo[83014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:37 devstack cinder-volume[82084]: WARNING py.warnings [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 01 08:04:37 devstack cinder-volume[82084]: .first() Apr 01 08:04:37 devstack cinder-volume[82084]: Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c 1G" returned: 0 in 0.922s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:37 devstack sudo[83016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c Apr 01 08:04:37 devstack sudo[83016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:37 devstack sudo[83014]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.manager [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:37 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Deleted volume successfully. Apr 01 08:04:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-bd7f6792-e987-4f7b-9f32-d1f0e79d0af5 req-d14257c4-a2be-47a8-9c10-e7eef935b565 tempest-VolumesGetTestJSON-1985742221 None] Lock "cinder-6e03196f-454f-4cc5-8d0d-c44ac53b7c18-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:38 devstack sudo[83011]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.866s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:38 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Deleted volume successfully. Apr 01 08:04:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e0180fdf-f4bd-4720-88a7-2b63fba479de tempest-VolumesAdminNegativeTest-31285208 None] Lock "cinder-59d1ae2a-21c2-422a-8524-e6e453a4d9a4-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:38 devstack sudo[83016]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c" returned: 0 in 1.019s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:38 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c is being set with open permissions: ugo+rw Apr 01 08:04:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:38 devstack sudo[83025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c Apr 01 08:04:38 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:39 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c" returned: 0 in 0.509s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:39 devstack sudo[83034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info Apr 01 08:04:39 devstack sudo[83034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:39 devstack sudo[83034]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info" returned: 0 in 0.619s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:39 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info is being set with open permissions: ugo+rw Apr 01 08:04:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:39 devstack sudo[83058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info Apr 01 08:04:39 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:40 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.info" returned: 0 in 0.489s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.440s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.714s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33c0c3-ffc4-43c1-9e86-84e9c57ac19e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-e782f546-6cb1-4fdd-acbe-a7c9cda162a0 req-fcd390a4-960f-4b44-942f-031601eeeaf9 tempest-VolumesSnapshotsTestJSON-109028945 None] Create snapshot completed successfully Apr 01 08:04:40 devstack sudo[83062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 Apr 01 08:04:40 devstack sudo[83062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "cinder-3a1eab11-a791-4ea4-9dc1-379405a1999c-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-3a1eab11-a791-4ea4-9dc1-379405a1999c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "cinder-quobyte-3a1eab11-a791-4ea4-9dc1-379405a1999c" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-3a1eab11-a791-4ea4-9dc1-379405a1999c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Deleting offline snapshot 3a1eab11-a791-4ea4-9dc1-379405a1999c of volume eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] snapshot_file for this snap is: volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41ac23b-a76e-47c2-a850-b8fea7fe01b5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:40 devstack sudo[83065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c Apr 01 08:04:40 devstack sudo[83065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:41 devstack sudo[83065]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c" returned: 0 in 0.579s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b9048-918d-40b2-8b39-3d03fd2e4407]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:41 devstack sudo[83062]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21" returned: 0 in 0.898s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.923s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5', 'name': 'volume-c93d7247-8ddf-4998-9664-0d69a0136c21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dfbf8e3-91a0-402d-8095-edef29756a96', 'enforce_multipath': True} {{(pid=82084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 01 08:04:41 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-d32269c4-218f-465c-af96-3e361cc243d7 req-d39461ab-f3e1-4293-ae82-8206ecd63f91 tempest-DeleteServersTestJSON-266002736 None] attachment_update completed successfully. Apr 01 08:04:41 devstack sudo[83073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 Apr 01 08:04:41 devstack sudo[83073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (8433e92c-9844-40f3-84e9-58eeafe62a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a494aa4b-1212-4a37-ad58-f185571550fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a494aa4b-1212-4a37-ad58-f185571550fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1540082533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09ee7db-ebbd-462a-a948-9a42c0d3fb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:42Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f442fe-5acb-4a69-ad64-6baea92f3dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f442fe-5acb-4a69-ad64-6baea92f3dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e052a96-a03b-4b6c-8b28-5a475b3cd301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e052a96-a03b-4b6c-8b28-5a475b3cd301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09ee7db-ebbd-462a-a948-9a42c0d3fb23', 'volume_name': 'volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed9f08f-424f-4437-ac42-cfb2603420e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed9f08f-424f-4437-ac42-cfb2603420e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c85ecd-9a99-4e5e-9ca4-89cbef41bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Volume b09ee7db-ebbd-462a-a948-9a42c0d3fb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23', 'volume_size': 1} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1540082533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09ee7db-ebbd-462a-a948-9a42c0d3fb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:42Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Creating volume b09ee7db-ebbd-462a-a948-9a42c0d3fb23 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:41 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:41 devstack sudo[83073]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392" returned: 0 in 0.673s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:41 devstack sudo[83104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 1073741824 Apr 01 08:04:41 devstack sudo[83104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:41 devstack sudo[83105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c Apr 01 08:04:41 devstack sudo[83105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:42 devstack sudo[83105]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c" returned: 0 in 0.498s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:42 devstack sudo[83158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c Apr 01 08:04:42 devstack sudo[83158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:42 devstack sudo[83104]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 1073741824" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:42 devstack sudo[83160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 Apr 01 08:04:42 devstack sudo[83160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:42 devstack sudo[83158]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392.3a1eab11-a791-4ea4-9dc1-379405a1999c" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-3a1eab11-a791-4ea4-9dc1-379405a1999c" released by "_delete_snapshot" :: held 2.300s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" released by "delete_snapshot" :: held 2.326s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:42 devstack cinder-volume[82084]: WARNING cinder.quota [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.quota [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Created reservations ['d4ef2a95-29a8-456e-af7c-73ad0142a9c3', 'ccaea2c2-4276-4d69-8035-0291b979cc28', '861b3b70-4bba-4aba-b392-e4b3e01dcc0b', 'dff3af9f-72ce-4c8c-9d6f-30368a560d8c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:42 devstack sudo[83160]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" returned: 0 in 0.530s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c85ecd-9a99-4e5e-9ca4-89cbef41bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2aa7f1c-8278-4363-a63e-33835eccbe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Volume volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 (b09ee7db-ebbd-462a-a948-9a42c0d3fb23): created successfully Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2aa7f1c-8278-4363-a63e-33835eccbe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (8433e92c-9844-40f3-84e9-58eeafe62a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e2332499-b1a1-481c-b5ff-685662b8f9b5 tempest-VolumesTestJSON-446648568 None] Created volume successfully. Apr 01 08:04:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Delete snapshot completed successfully. Apr 01 08:04:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-de134b77-a9cb-4e80-ba25-051a91e40d72 req-60f31a2d-74b9-498d-91c3-80963d9bfff4 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-3a1eab11-a791-4ea4-9dc1-379405a1999c-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "cinder-eaac0fb2-6c2a-4b87-93ad-c071b0602392-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-eaac0fb2-6c2a-4b87-93ad-c071b0602392-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a3210-9230-4852-b197-8dde6d604abd]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:43 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 Apr 01 08:04:43 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (9cb3a7a5-0b2f-4da6-8e21-9125088afc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3615b27f-2eaa-4305-b2e3-de5cbffad59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3615b27f-2eaa-4305-b2e3-de5cbffad59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965095004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714a67e7-cac0-4854-9cd5-81e5ec130658,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:44Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dbe6a6-d09f-4c46-a6db-566ca920efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dbe6a6-d09f-4c46-a6db-566ca920efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ee0f3c-a95e-40fa-8a91-931c5a8a4212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ee0f3c-a95e-40fa-8a91-931c5a8a4212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714a67e7-cac0-4854-9cd5-81e5ec130658', 'volume_name': 'volume-714a67e7-cac0-4854-9cd5-81e5ec130658', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9240614a-b983-4462-a67d-06d2f6dd8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9240614a-b983-4462-a67d-06d2f6dd8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2857e97e-c9db-4a04-b76f-f54841db9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Volume 714a67e7-cac0-4854-9cd5-81e5ec130658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714a67e7-cac0-4854-9cd5-81e5ec130658', 'volume_size': 1} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965095004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714a67e7-cac0-4854-9cd5-81e5ec130658,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:44Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Creating volume 714a67e7-cac0-4854-9cd5-81e5ec130658 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:44 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:44 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 1073741824 Apr 01 08:04:44 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:44 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392" returned: 0 in 0.688s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:44 devstack sudo[83488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392 Apr 01 08:04:44 devstack sudo[83488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:44 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 1073741824" returned: 0 in 0.526s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:44 devstack sudo[83493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 Apr 01 08:04:44 devstack sudo[83493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:45 devstack sudo[83488]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eaac0fb2-6c2a-4b87-93ad-c071b0602392" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-quobyte-eaac0fb2-6c2a-4b87-93ad-c071b0602392" released by "delete_volume" :: held 1.239s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.quota [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Created reservations ['8c6e3c68-658c-4abb-a5f4-76d187d885a5', 'f357d95f-b1e4-4b8b-846a-3af9eded47d8', '9dc58f1d-74ac-4d82-8780-40e7b573bdce', '7830113d-4041-4920-98be-2ece481f3892'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:45 devstack sudo[83496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:45 devstack sudo[83496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:45 devstack sudo[83493]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658" returned: 0 in 0.505s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2857e97e-c9db-4a04-b76f-f54841db9d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714a67e7-cac0-4854-9cd5-81e5ec130658', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f772c92-45b4-4617-82a3-4b865a31fefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:45 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Volume volume-714a67e7-cac0-4854-9cd5-81e5ec130658 (714a67e7-cac0-4854-9cd5-81e5ec130658): created successfully Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f772c92-45b4-4617-82a3-4b865a31fefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (9cb3a7a5-0b2f-4da6-8e21-9125088afc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-bf5d8acd-9b83-4197-8782-4fd96b94126f tempest-VolumesTestJSON-446648568 None] Created volume successfully. Apr 01 08:04:45 devstack sudo[83496]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.manager [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Deleted volume successfully. Apr 01 08:04:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-519c9575-eda6-4e1c-813b-a0b6436f4721 req-1a585302-1538-4611-95e1-622b8f905884 tempest-VolumesSnapshotsTestJSON-109028945 None] Lock "cinder-eaac0fb2-6c2a-4b87-93ad-c071b0602392-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (78e45fa5-cb30-480d-82a7-08636d9750f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4230f52-02dc-457b-8481-df8d6b7a45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4230f52-02dc-457b-8481-df8d6b7a45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-731258264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251e00b3-5c36-4e13-9fc9-1801ec969019,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:47Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5877b43d-b788-4a32-8938-3184143ddf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5877b43d-b788-4a32-8938-3184143ddf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6ec34a-b9fb-4850-a2f9-4c321f1f9647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6ec34a-b9fb-4850-a2f9-4c321f1f9647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251e00b3-5c36-4e13-9fc9-1801ec969019', 'volume_name': 'volume-251e00b3-5c36-4e13-9fc9-1801ec969019', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fad583-b8ca-4662-8e7e-4e621ede2620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fad583-b8ca-4662-8e7e-4e621ede2620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab5c66f-f9ea-4ed3-a9b9-0daa1e121fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:46 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Volume 251e00b3-5c36-4e13-9fc9-1801ec969019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251e00b3-5c36-4e13-9fc9-1801ec969019', 'volume_size': 1} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-731258264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251e00b3-5c36-4e13-9fc9-1801ec969019,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb53792f74705aab3f184660d304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:47Z,use_quota=True,user_id='b37499bac50948aeb691bb3edcb184cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Creating volume 251e00b3-5c36-4e13-9fc9-1801ec969019 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:46 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:46 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 1073741824 Apr 01 08:04:46 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:47 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 1073741824" returned: 0 in 0.582s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:47 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 Apr 01 08:04:47 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:48 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019" returned: 0 in 0.573s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab5c66f-f9ea-4ed3-a9b9-0daa1e121fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251e00b3-5c36-4e13-9fc9-1801ec969019', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c8696a-8434-41d2-81c1-fe43ea70f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Volume volume-251e00b3-5c36-4e13-9fc9-1801ec969019 (251e00b3-5c36-4e13-9fc9-1801ec969019): created successfully Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c8696a-8434-41d2-81c1-fe43ea70f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Flow 'volume_create_manager' (78e45fa5-cb30-480d-82a7-08636d9750f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4a2b24b2-05dc-454b-8fb7-e34fa6e8e3c6 tempest-VolumesTestJSON-446648568 None] Created volume successfully. Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-251e00b3-5c36-4e13-9fc9-1801ec969019-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "cinder-251e00b3-5c36-4e13-9fc9-1801ec969019-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-quobyte-251e00b3-5c36-4e13-9fc9-1801ec969019" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-251e00b3-5c36-4e13-9fc9-1801ec969019" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcfddd7-270b-48d5-8e48-bc483385b7a1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39f50a06-abe3-4a38-8309-9375c4c67de3 tempest-BackendsCapabilitiesAdminTestsJSON-1262630559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7029914855957, 'free_capacity_gb': 1775.7029914855957, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 01 08:04:49 devstack sudo[83579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 Apr 01 08:04:49 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-45fe6309-5fd4-4932-a976-7625dfe4e2ce req-a4c35958-5416-4239-b0ee-4de66701cfe6 tempest-DeleteServersTestJSON-266002736 None] Terminate volume connection completed successfully. Apr 01 08:04:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-45fe6309-5fd4-4932-a976-7625dfe4e2ce req-a4c35958-5416-4239-b0ee-4de66701cfe6 tempest-DeleteServersTestJSON-266002736 None] Deleting attachment 1dfbf8e3-91a0-402d-8095-edef29756a96. {{(pid=82084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 01 08:04:50 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019" returned: 0 in 0.507s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:50 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019 Apr 01 08:04:50 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-963cb26e-8634-4108-a730-9d15bdee715d tempest-BackendsCapabilitiesAdminTestsJSON-1262630559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7029914855957, 'free_capacity_gb': 1775.7029914855957, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 01 08:04:50 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-251e00b3-5c36-4e13-9fc9-1801ec969019" returned: 0 in 0.402s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-251e00b3-5c36-4e13-9fc9-1801ec969019" released by "delete_volume" :: held 0.930s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Created reservations ['c61078b8-44a9-4242-9543-9d1d4923107f', '9d0d616e-bf11-43bc-9889-c39feea3ca46', '02292db9-c221-4e29-b733-3a146b72e3cf', 'c429cc9b-adf8-4016-a8f1-7a5adb81ebb2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:50 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:50 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-714a67e7-cac0-4854-9cd5-81e5ec130658-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "cinder-714a67e7-cac0-4854-9cd5-81e5ec130658-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-quobyte-714a67e7-cac0-4854-9cd5-81e5ec130658" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-714a67e7-cac0-4854-9cd5-81e5ec130658" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd8e90-e334-432f-bc92-31a958aeb9a2]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:51 devstack sudo[83590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 Apr 01 08:04:51 devstack sudo[83590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:51 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.623s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:51 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Deleted volume successfully. Apr 01 08:04:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-23275a36-55b6-45bf-b1f6-134ef9c924c0 tempest-VolumesTestJSON-446648568 None] Lock "cinder-251e00b3-5c36-4e13-9fc9-1801ec969019-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:51 devstack sudo[83590]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658" returned: 0 in 0.678s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:51 devstack sudo[83597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658 Apr 01 08:04:51 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:52 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-714a67e7-cac0-4854-9cd5-81e5ec130658" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-714a67e7-cac0-4854-9cd5-81e5ec130658" released by "delete_volume" :: held 1.247s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Created reservations ['b02161a8-fd2b-45d4-b82c-92aa48478f99', '22130e95-3ab8-4af2-8c5f-95e67b3d9007', '4e75321a-6e31-4520-a8b5-700bc6171334', 'dab1af18-1e10-4b89-8580-e32bb06d1ced'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:52 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:52 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:52 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.482s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Deleted volume successfully. Apr 01 08:04:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-48dd0be6-670c-438d-a060-9ef297341aba tempest-VolumesTestJSON-446648568 None] Lock "cinder-714a67e7-cac0-4854-9cd5-81e5ec130658-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-b09ee7db-ebbd-462a-a948-9a42c0d3fb23-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "cinder-b09ee7db-ebbd-462a-a948-9a42c0d3fb23-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Acquiring lock "cinder-quobyte-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[99073644-78dd-4b94-be57-8dcf983b4dbd]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:53 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 Apr 01 08:04:53 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "cinder-c93d7247-8ddf-4998-9664-0d69a0136c21-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "cinder-c93d7247-8ddf-4998-9664-0d69a0136c21-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "cinder-quobyte-c93d7247-8ddf-4998-9664-0d69a0136c21" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "cinder-quobyte-c93d7247-8ddf-4998-9664-0d69a0136c21" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfda31a-11e0-4d9f-b0bb-be95431d69a1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:53 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 Apr 01 08:04:53 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:53 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" returned: 0 in 0.608s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:53 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23 Apr 01 08:04:53 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:54 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21" returned: 0 in 0.659s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:54 devstack sudo[83621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21 Apr 01 08:04:54 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:54 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "cinder-quobyte-b09ee7db-ebbd-462a-a948-9a42c0d3fb23" released by "delete_volume" :: held 1.207s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Created reservations ['a476f8ef-d757-4508-a0c5-1835b15f1121', '7c7c1ff3-57fc-4b17-9b23-cd1d8053da0b', '5981eb21-82e1-4476-a8ae-fcde6bbef808', '19864f71-1cb0-4971-8111-c60c73962f76'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:54 devstack sudo[83623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:54 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4a7f7b0e-c3d9-4cb5-9e76-7a2b4206a0cd tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-1089311662: creating Apr 01 08:04:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4a7f7b0e-c3d9-4cb5-9e76-7a2b4206a0cd tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-1089311662: created successfully Apr 01 08:04:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4a7f7b0e-c3d9-4cb5-9e76-7a2b4206a0cd tempest-GroupSnapshotsTest-863375310 None] Create group completed successfully. Apr 01 08:04:54 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c93d7247-8ddf-4998-9664-0d69a0136c21" returned: 0 in 0.533s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "cinder-quobyte-c93d7247-8ddf-4998-9664-0d69a0136c21" released by "delete_volume" :: held 1.214s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Created reservations ['c6a200d1-550b-47fc-ad72-098c441b4c52', '3765efe0-737f-4eab-b825-b421b0e5aa44', 'ddffdf7f-73a5-4615-bdf0-8cc92fe1a8bc', '6dc32eee-f21a-4202-9443-f19371884b60'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:54 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:54 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:54 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Deleted volume successfully. Apr 01 08:04:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-18f377e4-b2f9-42ed-b605-1a13684a8418 tempest-VolumesTestJSON-446648568 None] Lock "cinder-b09ee7db-ebbd-462a-a948-9a42c0d3fb23-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:55 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.461s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Deleted volume successfully. Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26678175-77ea-45d2-a401-301603634931 tempest-DeleteServersTestJSON-266002736 None] Lock "cinder-c93d7247-8ddf-4998-9664-0d69a0136c21-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:55 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:04:55 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (50838201-7fa9-4eab-bbac-3285082f6f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16fa8f4-8af8-4d78-b922-c27d53d7755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16fa8f4-8af8-4d78-b922-c27d53d7755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857948218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cbda9c3-3a8e-4471-a498-b847a4ffa159,host='devstack@QuobyteHD#QuobyteHD',id=e5fa8387-9e6c-4708-a654-368d816f72b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:56Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90f32976-092d-47d5-aa38-188bddb19b9f),volume_type_id=90f32976-092d-47d5-aa38-188bddb19b9f)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783710be-b983-4d9b-bfac-6a32d7a042b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783710be-b983-4d9b-bfac-6a32d7a042b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f17180-f079-4d7e-b0d4-7a013b43916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f17180-f079-4d7e-b0d4-7a013b43916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5fa8387-9e6c-4708-a654-368d816f72b6', 'volume_name': 'volume-e5fa8387-9e6c-4708-a654-368d816f72b6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f49e0-6d7f-4da5-bddd-9444cb41219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55f49e0-6d7f-4da5-bddd-9444cb41219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85c766c-6eb1-4ac9-9adc-b656b2f8e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Volume e5fa8387-9e6c-4708-a654-368d816f72b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5fa8387-9e6c-4708-a654-368d816f72b6', 'volume_size': 1} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cbda9c3-3a8e-4471-a498-b847a4ffa159,created_at=2026-04-01T06:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857948218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cbda9c3-3a8e-4471-a498-b847a4ffa159,host='devstack@QuobyteHD#QuobyteHD',id=e5fa8387-9e6c-4708-a654-368d816f72b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:04:56Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90f32976-092d-47d5-aa38-188bddb19b9f),volume_type_id=90f32976-092d-47d5-aa38-188bddb19b9f)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Creating volume e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:04:56 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:56 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 1073741824 Apr 01 08:04:56 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:56 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.649s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:04:56 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 1073741824" returned: 0 in 0.594s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:56 devstack sudo[83673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:04:56 devstack sudo[83673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:57 devstack sudo[83673]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.610s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85c766c-6eb1-4ac9-9adc-b656b2f8e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5fa8387-9e6c-4708-a654-368d816f72b6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6f1494-41a1-4daf-9901-dc6afbda7148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:04:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Volume volume-e5fa8387-9e6c-4708-a654-368d816f72b6 (e5fa8387-9e6c-4708-a654-368d816f72b6): created successfully Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6f1494-41a1-4daf-9901-dc6afbda7148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:04:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (50838201-7fa9-4eab-bbac-3285082f6f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:04:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b2020b32-7545-4d06-a2d8-977b3493aa99 tempest-GroupSnapshotsTest-863375310 None] Created volume successfully. Apr 01 08:04:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] GroupSnapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: creating. Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Group snapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: creating. {{(pid=82084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Creating offline snapshot b445db5b-2f07-4e08-a5a2-4440eaae385a of volume e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c4f68c-50d9-440f-878b-6e0c5180f84b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:04:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:58 devstack sudo[83677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:04:58 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0a3bec1f-33de-4c04-96ff-8a04bb5e2919 tempest-GroupsV314Test-627375439 None] Group tempest-GroupsV314Test-Group-705550578: creating Apr 01 08:04:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0a3bec1f-33de-4c04-96ff-8a04bb5e2919 tempest-GroupsV314Test-627375439 None] Group tempest-GroupsV314Test-Group-705550578: created successfully Apr 01 08:04:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0a3bec1f-33de-4c04-96ff-8a04bb5e2919 tempest-GroupsV314Test-627375439 None] Create group completed successfully. Apr 01 08:04:59 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.531s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:59 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a 1G Apr 01 08:04:59 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:04:59 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 01 08:04:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a 1G" returned: 0 in 0.530s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:04:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fa8387-9e6c-4708-a654-368d816f72b6 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:04:59 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fa8387-9e6c-4708-a654-368d816f72b6 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:04:59 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:00 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fa8387-9e6c-4708-a654-368d816f72b6 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.613s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:00 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:00 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:05:00 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Flow 'volume_create_manager' (1b6a729c-9451-4345-a761-d1c6934020d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bf70d1-d44f-43b8-94be-1a3adbb500cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bf70d1-d44f-43b8-94be-1a3adbb500cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975805162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b7abe84-87bb-4bd0-b4b3-551ed63c7384,host='devstack@QuobyteHD#QuobyteHD',id=58d635fe-108f-45d4-9831-8e7b956cb085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a196f888043c293110bd75fae68da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:00Z,use_quota=True,user_id='3332724decb64e17b7c6119e424190e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b1807bd-7064-4f43-b76e-528a83638652),volume_type_id=4b1807bd-7064-4f43-b76e-528a83638652)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b56d09-fe62-4c8e-9523-df36a13415ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b56d09-fe62-4c8e-9523-df36a13415ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf304052-d3d9-4d30-8d3d-52a5118b8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf304052-d3d9-4d30-8d3d-52a5118b8563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d635fe-108f-45d4-9831-8e7b956cb085', 'volume_name': 'volume-58d635fe-108f-45d4-9831-8e7b956cb085', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcbcba-cb3f-44a3-a132-edf0473fd039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcbcba-cb3f-44a3-a132-edf0473fd039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684e3350-89b3-4930-b57f-8c98ac2377dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:00 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Volume 58d635fe-108f-45d4-9831-8e7b956cb085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d635fe-108f-45d4-9831-8e7b956cb085', 'volume_size': 1} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:00 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:00 devstack sudo[83696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info Apr 01 08:05:00 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:01 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:01 devstack sudo[83700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info Apr 01 08:05:01 devstack sudo[83700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:01 devstack sudo[83700]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.info" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b7abe84-87bb-4bd0-b4b3-551ed63c7384,created_at=2026-04-01T06:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975805162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b7abe84-87bb-4bd0-b4b3-551ed63c7384,host='devstack@QuobyteHD#QuobyteHD',id=58d635fe-108f-45d4-9831-8e7b956cb085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a196f888043c293110bd75fae68da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:00Z,use_quota=True,user_id='3332724decb64e17b7c6119e424190e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b1807bd-7064-4f43-b76e-528a83638652),volume_type_id=4b1807bd-7064-4f43-b76e-528a83638652)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Creating volume 58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:01 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:01 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 1073741824 Apr 01 08:05:01 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7fc0d7d0-c5a7-44b3-98a1-fb6bf756de02 tempest-GroupSnapshotsTest-863375310 None] group_snapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: created successfully Apr 01 08:05:02 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 1073741824" returned: 0 in 0.646s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:02 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:02 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:02 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.496s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684e3350-89b3-4930-b57f-8c98ac2377dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d635fe-108f-45d4-9831-8e7b956cb085', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490d64f4-73d5-4e1e-aa05-16ab6bf73dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:02 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Volume volume-58d635fe-108f-45d4-9831-8e7b956cb085 (58d635fe-108f-45d4-9831-8e7b956cb085): created successfully Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490d64f4-73d5-4e1e-aa05-16ab6bf73dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Flow 'volume_create_manager' (1b6a729c-9451-4345-a761-d1c6934020d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-130ccd3d-df70-4a31-a13f-3277047fdb7a tempest-GroupsV314Test-627375439 None] Created volume successfully. Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a-551a5469-3d1d-4eec-a3e9-8cf282990b9a" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a-551a5469-3d1d-4eec-a3e9-8cf282990b9a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Creating volume 551a5469-3d1d-4eec-a3e9-8cf282990b9a from snapshot b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] snapshot: b445db5b-2f07-4e08-a5a2-4440eaae385a, volume: 551a5469-3d1d-4eec-a3e9-8cf282990b9a, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fbbb6f-a3f4-4c37-985a-fc2ee348a723]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:04 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:05:04 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:04 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.641s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5fa8387-9e6c-4708-a654-368d816f72b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c988fd51-6ce6-48dc-80f3-9b200a26d0ed]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:04 devstack sudo[83717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:05:04 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:05 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:05 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:05:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:05 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a Apr 01 08:05:05 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:07 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a" returned: 0 in 2.471s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:07 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391b4fe-4c53-481f-a91d-f631d38c9527]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:07 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:05:07 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:08 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.642s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:05:08 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Converted 1024.00 MB image at 414.03 MB/s Apr 01 08:05:08 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:08 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a Apr 01 08:05:08 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:08 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" released by "_copy_volume_from_snapshot" :: held 4.816s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a-551a5469-3d1d-4eec-a3e9-8cf282990b9a" released by "_create_volume_from_snapshot" :: held 4.836s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.853s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.250s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:08 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Cloning volume 58d635fe-108f-45d4-9831-8e7b956cb085 to volume 03beeb2e-de82-4f5a-a5d3-82b346689c08 Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Creating offline snapshot 1299b630-a266-45cf-a2ab-46da2ed62ed1 of volume 58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e86ca-9f78-4e10-b1b9-a5979112d3f8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-93affc11-bb1f-4499-8d1f-9cf808c0296c tempest-GroupSnapshotsTest-863375310 None] Create group from source-snapshot-e03b360e-1453-4edc-a1c4-84c9a7a88cbd completed successfully. Apr 01 08:05:08 devstack sudo[83765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:08 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:09 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.539s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:09 devstack sudo[83770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 1G Apr 01 08:05:09 devstack sudo[83770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:09 devstack sudo[83770]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 1G" returned: 0 in 0.645s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d635fe-108f-45d4-9831-8e7b956cb085 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[33312dc5-599b-484a-8a84-50856d997aae]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:10 devstack sudo[83775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d635fe-108f-45d4-9831-8e7b956cb085 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:10 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:10 devstack sudo[83776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a Apr 01 08:05:10 devstack sudo[83776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:10 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d635fe-108f-45d4-9831-8e7b956cb085 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.551s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:10 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:10 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:10 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:10 devstack sudo[83776]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a" returned: 0 in 0.637s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:10 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a Apr 01 08:05:10 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:11 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.458s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:11 devstack sudo[83791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info Apr 01 08:05:11 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:11 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-551a5469-3d1d-4eec-a3e9-8cf282990b9a" returned: 0 in 0.460s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-551a5469-3d1d-4eec-a3e9-8cf282990b9a" released by "delete_volume" :: held 1.125s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Created reservations ['f173cf93-5f09-4a40-a265-b20e2a956db7'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:11 devstack cinder-volume[82084]: WARNING cinder.quota [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1171203645 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1171203645, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:11 devstack cinder-volume[82084]: WARNING cinder.quota [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1171203645 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1171203645, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Created reservations ['c1f07743-b759-4378-9b01-7670164d64f9', '29178c9a-6fd8-4389-9d09-3036b0e77afd', 'e3ff9a74-6027-4e57-a785-03fbb0de1aaf', 'd178e2b7-2b7a-466d-97f6-599523d712dd'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:11 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:11 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:11 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info" returned: 0 in 0.647s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:11 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:11 devstack sudo[83798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info Apr 01 08:05:11 devstack sudo[83798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:11 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.463s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:11 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-26370f3d-872a-4cda-80ab-cfdbf10a33ed tempest-GroupSnapshotsTest-863375310 None] Delete group completed successfully. Apr 01 08:05:12 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] group_snapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: deleting Apr 01 08:05:12 devstack sudo[83798]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] group_snapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: deleting {{(pid=82084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.info" returned: 0 in 0.565s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Acquiring lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] snapshot: 1299b630-a266-45cf-a2ab-46da2ed62ed1, volume: 03beeb2e-de82-4f5a-a5d3-82b346689c08, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dceee8-ebf5-4cb9-b1a7-92822a55b55c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Deleting offline snapshot b445db5b-2f07-4e08-a5a2-4440eaae385a of volume e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] snapshot_file for this snap is: volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea3cdc-0678-4217-b294-99c39ce48ca7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:12 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:12 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:12 devstack sudo[83803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:05:12 devstack sudo[83803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:12 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.575s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d635fe-108f-45d4-9831-8e7b956cb085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bea8daa-dc65-4f04-829f-d04f853f55b3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:12 devstack sudo[83803]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.591s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5fa8387-9e6c-4708-a654-368d816f72b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c7a161-1c23-4e55-aa69-77de4e869c93]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:13 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:13 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:13 devstack sudo[83814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:05:13 devstack sudo[83814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:13 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.757s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:13 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:05:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:13 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 Apr 01 08:05:13 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:13 devstack sudo[83814]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.734s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:13 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:05:13 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:14 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.616s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:14 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a Apr 01 08:05:14 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:15 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6.b445db5b-2f07-4e08-a5a2-4440eaae385a" returned: 0 in 0.896s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-b445db5b-2f07-4e08-a5a2-4440eaae385a" released by "_delete_snapshot" :: held 2.909s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" released by "delete_snapshot" :: held 2.952s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:15 devstack cinder-volume[82084]: WARNING cinder.quota [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1171203645 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1171203645, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:15 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['f52ae956-a7a5-4dfa-bdf5-00e7252d1704', '93d4d107-964e-432c-9cb0-f567259c57b1', '63a3c988-73fd-4a46-902d-5582c0ab3af9', '2c481483-8790-484c-b0f8-6b532b2689ec'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-90fc840d-6467-4005-9bdd-c432df319e15 tempest-GroupSnapshotsTest-863375310 None] group_snapshot e03b360e-1453-4edc-a1c4-84c9a7a88cbd: deleted successfully Apr 01 08:05:16 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08" returned: 0 in 2.328s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[831dd81d-4986-4c1f-8af5-cd906a2c9188]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:16 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:16 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:16 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.578s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:05:16 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Converted 1024.00 MB image at 439.82 MB/s Apr 01 08:05:16 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:16 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 Apr 01 08:05:16 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e84ae8e-58d3-4e3b-9d3d-97e796061d83]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:16 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:05:16 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:17 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08" returned: 0 in 0.418s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" released by "_copy_volume_from_snapshot" :: held 4.711s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Acquiring lock "cinder-quobyte-1299b630-a266-45cf-a2ab-46da2ed62ed1" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-1299b630-a266-45cf-a2ab-46da2ed62ed1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Deleting offline snapshot 1299b630-a266-45cf-a2ab-46da2ed62ed1 of volume 58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] snapshot_file for this snap is: volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74555bd2-d2ad-40f8-a2d9-7a285317355a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:17 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:17 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:17 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:17 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6 Apr 01 08:05:17 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:17 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d635fe-108f-45d4-9831-8e7b956cb085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ba2fc-449a-4e76-a4ca-c49e960ebaa0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:17 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:17 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:17 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e5fa8387-9e6c-4708-a654-368d816f72b6" returned: 0 in 0.450s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-e5fa8387-9e6c-4708-a654-368d816f72b6" released by "delete_volume" :: held 0.962s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['ab764346-be32-4d26-a9c4-a1c6154ddc7b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:17 devstack cinder-volume[82084]: WARNING cinder.db.sqlalchemy.api [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1171203645'] Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['1eefad8d-4206-4811-afa4-0fcf1d4871be', '187f761f-3648-4dbf-b0a0-c120595f1225', '7a6220ee-2c5b-47bf-af8d-0a43c7407e76', '2f0f4f01-f5bc-4283-82ac-71f8e293fdfe'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:17 devstack sudo[83894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:17 devstack sudo[83894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:18 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.477s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:18 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:18 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:18 devstack sudo[83894]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-8f528dcd-d6f9-4134-af6a-86d64a67a1c2 tempest-GroupSnapshotsTest-863375310 None] Delete group completed successfully. Apr 01 08:05:18 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.563s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:18 devstack sudo[83931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1 Apr 01 08:05:18 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:19 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085.1299b630-a266-45cf-a2ab-46da2ed62ed1" returned: 0 in 0.612s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-1299b630-a266-45cf-a2ab-46da2ed62ed1" released by "_delete_snapshot" :: held 2.232s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.535s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-31e87516-9bc9-4e8a-b83d-a76e26f7fb54 tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-1302369715: creating Apr 01 08:05:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-120773d0-236f-4e0b-8ba2-5bb1f7d3ae88 tempest-GroupsV314Test-627375439 None] Create group from source-group-8b7abe84-87bb-4bd0-b4b3-551ed63c7384 completed successfully. Apr 01 08:05:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-31e87516-9bc9-4e8a-b83d-a76e26f7fb54 tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-1302369715: created successfully Apr 01 08:05:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-31e87516-9bc9-4e8a-b83d-a76e26f7fb54 tempest-GroupSnapshotsTest-863375310 None] Create group completed successfully. Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=124,cinder:UPDATE=141,cinder:INSERT=34,cinder:DELETE=7 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Acquiring lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" acquired by "delete_volume" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2888d61-5cc9-4247-b9f2-fd9764f3b129]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:20 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 Apr 01 08:05:20 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (acf0bd62-bdec-45fa-b16b-5bf992b92048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dd3d1f-c5ab-43ae-96cb-b0922669d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=111,cinder:UPDATE=118,cinder:DELETE=10,cinder:INSERT=25 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dd3d1f-c5ab-43ae-96cb-b0922669d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733529635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,host='devstack@QuobyteHD#QuobyteHD',id=65e91b96-4253-425e-a671-3c64baea8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:21Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e8c9d3a-4890-4e11-82c5-2d161fce8143),volume_type_id=2e8c9d3a-4890-4e11-82c5-2d161fce8143)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce7236-00c0-4ba0-ac81-058c9dadcdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce7236-00c0-4ba0-ac81-058c9dadcdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef641384-50ea-4d44-a9be-29e798f7e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef641384-50ea-4d44-a9be-29e798f7e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e91b96-4253-425e-a671-3c64baea8d71', 'volume_name': 'volume-65e91b96-4253-425e-a671-3c64baea8d71', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e789051c-7277-4652-ae19-5a7713302c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e789051c-7277-4652-ae19-5a7713302c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58327e5-b3da-49f7-a20b-4d243672f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Volume 65e91b96-4253-425e-a671-3c64baea8d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e91b96-4253-425e-a671-3c64baea8d71', 'volume_size': 1} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,created_at=2026-04-01T06:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733529635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,host='devstack@QuobyteHD#QuobyteHD',id=65e91b96-4253-425e-a671-3c64baea8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:21Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e8c9d3a-4890-4e11-82c5-2d161fce8143),volume_type_id=2e8c9d3a-4890-4e11-82c5-2d161fce8143)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Creating volume 65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:20 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:20 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 1073741824 Apr 01 08:05:20 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:21 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08" returned: 0 in 0.671s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:21 devstack sudo[83963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08 Apr 01 08:05:21 devstack sudo[83963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:21 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 1073741824" returned: 0 in 0.629s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:21 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 Apr 01 08:05:21 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:21 devstack sudo[83963]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-03beeb2e-de82-4f5a-a5d3-82b346689c08" returned: 0 in 0.533s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-03beeb2e-de82-4f5a-a5d3-82b346689c08" released by "delete_volume" :: held 1.272s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Created reservations ['ad27f7a7-aa78-4505-a65e-cafcc44b5c57'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:21 devstack cinder-volume[82084]: WARNING cinder.quota [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1057304785 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1057304785, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:21 devstack cinder-volume[82084]: WARNING cinder.quota [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1057304785 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1057304785, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:21 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Created reservations ['92fb26fe-330d-4d25-92d3-dcfd3808d857', '7850b1ff-68ae-48ca-8f73-779ccdfab3b5', '4311f2ef-7ad1-4694-bd0e-389f9693b5d0', '1a442dad-195b-49d9-9ace-9e69785a659b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:22 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:22 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:22 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71" returned: 0 in 0.732s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58327e5-b3da-49f7-a20b-4d243672f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e91b96-4253-425e-a671-3c64baea8d71', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8c10f0-0c29-4ead-bc90-8950d050b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:22 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Volume volume-65e91b96-4253-425e-a671-3c64baea8d71 (65e91b96-4253-425e-a671-3c64baea8d71): created successfully Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8c10f0-0c29-4ead-bc90-8950d050b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (acf0bd62-bdec-45fa-b16b-5bf992b92048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9783b0ed-3ad6-4f84-a518-39ca0ef48f97 tempest-GroupSnapshotsTest-863375310 None] Created volume successfully. Apr 01 08:05:22 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ea443f53-0d80-4c5f-9dc0-7e6c30d44e05 tempest-GroupsV314Test-627375439 None] Delete group completed successfully. Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Acquiring lock "cinder-quobyte-58d635fe-108f-45d4-9831-8e7b956cb085" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-58d635fe-108f-45d4-9831-8e7b956cb085" acquired by "delete_volume" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86e5e2-50a7-4242-96c5-ee4df88ff8ed]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:23 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:23 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (d43e2435-d656-4fb9-960d-b7dd06c62ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932f324-998a-4593-afa1-2495e08d918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932f324-998a-4593-afa1-2495e08d918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1930328003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,host='devstack@QuobyteHD#QuobyteHD',id=14435bf6-c351-481e-89f7-ff514265e24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:23Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e8c9d3a-4890-4e11-82c5-2d161fce8143),volume_type_id=2e8c9d3a-4890-4e11-82c5-2d161fce8143)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67476d6a-f68b-499e-8275-a74cafd26d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67476d6a-f68b-499e-8275-a74cafd26d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c05222-35a4-499d-bad0-04d81a76a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c05222-35a4-499d-bad0-04d81a76a34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14435bf6-c351-481e-89f7-ff514265e24e', 'volume_name': 'volume-14435bf6-c351-481e-89f7-ff514265e24e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06750378-ccbd-4a29-83af-0356512c6144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06750378-ccbd-4a29-83af-0356512c6144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f6963f-4a95-4395-93e3-9e4e2f65ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:23 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Volume 14435bf6-c351-481e-89f7-ff514265e24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14435bf6-c351-481e-89f7-ff514265e24e', 'volume_size': 1} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,created_at=2026-04-01T06:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1930328003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f671000-4443-4e0f-acaa-5bdf9e3110b4,host='devstack@QuobyteHD#QuobyteHD',id=14435bf6-c351-481e-89f7-ff514265e24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:23Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e8c9d3a-4890-4e11-82c5-2d161fce8143),volume_type_id=2e8c9d3a-4890-4e11-82c5-2d161fce8143)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Creating volume 14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:23 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:23 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e 1073741824 Apr 01 08:05:23 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:23 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.592s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:23 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085 Apr 01 08:05:23 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:23 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e 1073741824" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:24 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e Apr 01 08:05:24 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:24 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-58d635fe-108f-45d4-9831-8e7b956cb085" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Lock "cinder-quobyte-58d635fe-108f-45d4-9831-8e7b956cb085" released by "delete_volume" :: held 1.064s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Created reservations ['3d3ef18d-b56b-42e7-af49-e8cac66d0f04'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Created reservations ['78bacb0e-0d31-427a-8fa4-ef058abf50a8', 'b16211f4-f259-44b2-a100-aa2edd90a485', 'd845b800-947c-42c3-825a-84ed0924ff57', '0d3f2f55-8e6a-47b3-8d2d-fb41f69c9ec4'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:24 devstack sudo[83997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:24 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:24 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e" returned: 0 in 0.524s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f6963f-4a95-4395-93e3-9e4e2f65ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14435bf6-c351-481e-89f7-ff514265e24e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ae20f-3d88-4f89-a1cc-1de843e4dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:24 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Volume volume-14435bf6-c351-481e-89f7-ff514265e24e (14435bf6-c351-481e-89f7-ff514265e24e): created successfully Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ae20f-3d88-4f89-a1cc-1de843e4dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (d43e2435-d656-4fb9-960d-b7dd06c62ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:24 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c592d0f6-e1f9-456b-a63b-663dafe4df99 tempest-GroupSnapshotsTest-863375310 None] Created volume successfully. Apr 01 08:05:24 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.671s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:24 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:24 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f2479377-d00d-4383-be3c-8da236267bc0 tempest-GroupsV314Test-627375439 None] Delete group completed successfully. Apr 01 08:05:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2b4beecb-e53a-44f8-9610-d500be9f6620 tempest-GroupSnapshotsTest-863375310 None] Update group completed successfully. Apr 01 08:05:27 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-357d6f32-d654-45fc-8357-67f0717a87fc tempest-GroupSnapshotsTest-863375310 None] Update group completed successfully. Apr 01 08:05:28 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6e18ba5c-67db-4e4a-8152-debf56be28fd tempest-GroupSnapshotsTest-863375310 None] Update group completed successfully. Apr 01 08:05:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-adbc1f89-9f93-4039-b6e8-5fcf5de32267 tempest-GroupSnapshotsTest-863375310 None] Update group completed successfully. Apr 01 08:05:31 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] GroupSnapshot 260a42c5-d098-4b88-8816-43432c4d09bb: creating. Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Group snapshot 260a42c5-d098-4b88-8816-43432c4d09bb: creating. {{(pid=82084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Creating offline snapshot 281dc644-0b8e-4503-a29d-839f13e41252 of volume 14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c68b2-5dfc-478b-8d39-98331c309029]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:31 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e Apr 01 08:05:31 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:32 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e" returned: 0 in 0.764s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:32 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 1G Apr 01 08:05:32 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:32 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 1G" returned: 0 in 0.603s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14435bf6-c351-481e-89f7-ff514265e24e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:32 devstack sudo[84084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14435bf6-c351-481e-89f7-ff514265e24e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 Apr 01 08:05:32 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:33 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14435bf6-c351-481e-89f7-ff514265e24e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252" returned: 0 in 0.996s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:33 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:33 devstack sudo[84091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 Apr 01 08:05:33 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:34 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252" returned: 0 in 0.881s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:34 devstack sudo[84100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info Apr 01 08:05:34 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:36 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info" returned: 0 in 1.573s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:36 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:36 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info Apr 01 08:05:36 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:37 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.info" returned: 0 in 1.340s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.270s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Creating offline snapshot 5de5f9bd-f968-47f1-bc7e-07f47ad248cb of volume 65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07591e-e421-4cd9-80dd-a987f9b5cbb8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:37 devstack sudo[84130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 Apr 01 08:05:37 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Flow 'volume_create_manager' (deccbf2e-4cf1-4190-9f7a-edb1c68d62b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82fe694-0266-45c5-9ebc-1464be8fd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82fe694-0266-45c5-9ebc-1464be8fd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:38Z,deleted=False,deleted_at=None,display_description='',display_name='303ac84d-2eaa-4364-9572-fe3c50af5fde-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f393005-0f8a-4a29-9b4b-740aed030d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69325ee12b343f4ad9dbf36da9ae2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:38Z,use_quota=True,user_id='aca91e3aeca1461caf3ad9e3be6e9d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cf001d-0c19-4917-ab60-96d6336ae454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cf001d-0c19-4917-ab60-96d6336ae454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21809436-3b18-4ddf-b0dd-62ab143be9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21809436-3b18-4ddf-b0dd-62ab143be9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f393005-0f8a-4a29-9b4b-740aed030d15', 'volume_name': 'volume-2f393005-0f8a-4a29-9b4b-740aed030d15', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671f4397-0584-465b-945b-334b3d84a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671f4397-0584-465b-945b-334b3d84a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccbe2a5-3fc2-43e6-99fd-c7c60f251ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:38 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume 2f393005-0f8a-4a29-9b4b-740aed030d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f393005-0f8a-4a29-9b4b-740aed030d15', 'volume_size': 1} Apr 01 08:05:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:39 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71" returned: 0 in 1.330s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:39 devstack sudo[84137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb 1G Apr 01 08:05:39 devstack sudo[84137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Flow 'volume_create_manager' (dbe1cd3d-5265-44a3-a107-91997a6f71ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb669be3-47cb-44b3-a231-4fad539f4274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb669be3-47cb-44b3-a231-4fad539f4274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2028311649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa030d6-2649-4d6d-ae5e-fbaef26391dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb63ab1ff8cc4d8486233d03c60fc329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:39Z,use_quota=True,user_id='148118bbb1624dda9989f84c40d0cdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd0008f-5f06-477f-9703-9a9a3a8606cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd0008f-5f06-477f-9703-9a9a3a8606cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a257c-b257-41e1-abab-6d6b25c57be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984a257c-b257-41e1-abab-6d6b25c57be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa030d6-2649-4d6d-ae5e-fbaef26391dd', 'volume_name': 'volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea8efc8-35e2-49e0-86ae-fd97b7503dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea8efc8-35e2-49e0-86ae-fd97b7503dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42544f9d-d5c8-4fb5-939d-a4d5382b463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:39 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd', 'volume_size': 1} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:39 devstack sudo[84137]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb 1G" returned: 0 in 0.747s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e91b96-4253-425e-a671-3c64baea8d71 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:39 devstack sudo[84144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e91b96-4253-425e-a671-3c64baea8d71 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb Apr 01 08:05:39 devstack sudo[84144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:40 devstack sudo[84144]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65e91b96-4253-425e-a671-3c64baea8d71 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb" returned: 0 in 0.855s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:40 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:40 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb Apr 01 08:05:40 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:41 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb" returned: 0 in 0.566s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:41 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info Apr 01 08:05:41 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:42 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info" returned: 0 in 0.812s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:42 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:42 devstack sudo[84190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info Apr 01 08:05:42 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:42 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.info" returned: 0 in 0.896s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.422s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.538s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:38Z,deleted=False,deleted_at=None,display_description='',display_name='303ac84d-2eaa-4364-9572-fe3c50af5fde-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f393005-0f8a-4a29-9b4b-740aed030d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69325ee12b343f4ad9dbf36da9ae2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:38Z,use_quota=True,user_id='aca91e3aeca1461caf3ad9e3be6e9d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Creating volume 2f393005-0f8a-4a29-9b4b-740aed030d15 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:42 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:43 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 1073741824 Apr 01 08:05:43 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:43 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e4cf9e3a-b642-4669-8fd6-3c512938a548 tempest-GroupSnapshotsTest-863375310 None] group_snapshot 260a42c5-d098-4b88-8816-43432c4d09bb: created successfully Apr 01 08:05:43 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 1073741824" returned: 0 in 0.882s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:43 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 Apr 01 08:05:43 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] group_snapshot 260a42c5-d098-4b88-8816-43432c4d09bb: deleting Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] group_snapshot 260a42c5-d098-4b88-8816-43432c4d09bb: deleting {{(pid=82084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-281dc644-0b8e-4503-a29d-839f13e41252" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-281dc644-0b8e-4503-a29d-839f13e41252" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Deleting offline snapshot 281dc644-0b8e-4503-a29d-839f13e41252 of volume 14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] snapshot_file for this snap is: volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:05:44 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15" returned: 0 in 0.639s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.165s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2028311649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa030d6-2649-4d6d-ae5e-fbaef26391dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb63ab1ff8cc4d8486233d03c60fc329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:39Z,use_quota=True,user_id='148118bbb1624dda9989f84c40d0cdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Creating volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:44 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2988dc1-0a44-42a3-98c8-05ec044b91cb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:44 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd 1073741824 Apr 01 08:05:44 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccbe2a5-3fc2-43e6-99fd-c7c60f251ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f393005-0f8a-4a29-9b4b-740aed030d15', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79e4ffd-06f4-47f2-be9c-fb6c28913fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume volume-2f393005-0f8a-4a29-9b4b-740aed030d15 (2f393005-0f8a-4a29-9b4b-740aed030d15): created successfully Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79e4ffd-06f4-47f2-be9c-fb6c28913fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Flow 'volume_create_manager' (deccbf2e-4cf1-4190-9f7a-edb1c68d62b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-630fabed-91b5-43c1-adb7-82802d073a5d tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Created volume successfully. Apr 01 08:05:44 devstack sudo[84210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 Apr 01 08:05:44 devstack sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:45 devstack sudo[84210]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252" returned: 0 in 0.857s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14435bf6-c351-481e-89f7-ff514265e24e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b216d1-03c6-449e-b2bc-8a30a3f250f7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:45 devstack sudo[84220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e Apr 01 08:05:45 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:45 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd 1073741824" returned: 0 in 1.196s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:45 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd Apr 01 08:05:45 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:46 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e" returned: 0 in 0.732s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:46 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 Apr 01 08:05:46 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:46 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" returned: 0 in 0.714s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42544f9d-d5c8-4fb5-939d-a4d5382b463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028c8a6-d09a-4bdc-bf07-ba174b8621ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:46 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Volume volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd (8aa030d6-2649-4d6d-ae5e-fbaef26391dd): created successfully Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028c8a6-d09a-4bdc-bf07-ba174b8621ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Flow 'volume_create_manager' (dbe1cd3d-5265-44a3-a107-91997a6f71ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:46 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0545c8a3-1312-4d7f-8028-9dedcede2218 tempest-SnapshotsActionsTest-1143479745 None] Created volume successfully. Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Creating offline snapshot 7acd8d35-482a-4376-aa40-78bb06aa2f3b of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc7877a-b984-42d2-a190-23e6f0a3379b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:47 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252" returned: 0 in 0.926s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:47 devstack sudo[84263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252 Apr 01 08:05:47 devstack sudo[84263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:47 devstack sudo[84262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd Apr 01 08:05:47 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:47 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" returned: 0 in 0.577s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:47 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b 1G Apr 01 08:05:47 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:47 devstack sudo[84263]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e.281dc644-0b8e-4503-a29d-839f13e41252" returned: 0 in 0.748s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-281dc644-0b8e-4503-a29d-839f13e41252" released by "_delete_snapshot" :: held 3.478s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" released by "delete_snapshot" :: held 3.503s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-5de5f9bd-f968-47f1-bc7e-07f47ad248cb" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-5de5f9bd-f968-47f1-bc7e-07f47ad248cb" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Deleting offline snapshot 5de5f9bd-f968-47f1-bc7e-07f47ad248cb of volume 65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:05:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] snapshot_file for this snap is: volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7f79a2-7f70-4013-bc60-6e6cc5162766]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:48 devstack sudo[84281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb Apr 01 08:05:48 devstack sudo[84281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:48 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b 1G" returned: 0 in 0.880s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:48 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:05:48 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:48 devstack sudo[84281]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb" returned: 0 in 0.626s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65e91b96-4253-425e-a671-3c64baea8d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f625805-2685-496a-816f-84ffd77701c4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:48 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 Apr 01 08:05:48 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:49 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.598s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:49 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b is being set with open permissions: ugo+rw Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:49 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:05:49 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:49 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71" returned: 0 in 0.629s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:49 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb Apr 01 08:05:49 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:49 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.494s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:49 devstack sudo[84314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info Apr 01 08:05:49 devstack sudo[84314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:49 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb" returned: 0 in 0.531s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:49 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb Apr 01 08:05:49 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:50 devstack sudo[84314]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info" returned: 0 in 0.498s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:50 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info is being set with open permissions: ugo+rw Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:50 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info Apr 01 08:05:50 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:50 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71.5de5f9bd-f968-47f1-bc7e-07f47ad248cb" returned: 0 in 0.626s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-5de5f9bd-f968-47f1-bc7e-07f47ad248cb" released by "_delete_snapshot" :: held 2.515s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" released by "delete_snapshot" :: held 2.530s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:50 devstack cinder-volume[82084]: WARNING cinder.quota [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2008257162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2008257162, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:50 devstack cinder-volume[82084]: WARNING cinder.quota [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2008257162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2008257162, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['3ff94e70-4417-453a-b233-699ef61a3a65', 'c23d9331-fb32-452a-8d7c-b071e53b1145', '90e248aa-6032-433a-baff-edd5695d5fb7', '0cfe5894-1e7e-46ae-b45a-cf0937649bcb'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['e3b57b8f-bb33-441f-9b1a-92bcb9524c49', '8ec78dd0-d337-413a-b23a-9992ec9b60ca', '644c8beb-8214-446f-adab-4c984715e798', 'b194af54-9991-4fd9-9e8d-e331855c52b5'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:50 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.info" returned: 0 in 0.527s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.704s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.010s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03cb4ea-dd75-4cd8-b0fd-05cffe19703f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2218d426-db73-40cb-997c-e22c7806c492 tempest-SnapshotsActionsTest-1143479745 None] Create snapshot completed successfully Apr 01 08:05:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-74cfdcfa-1572-4a55-b30c-7618cf0ee186 tempest-GroupSnapshotsTest-863375310 None] group_snapshot 260a42c5-d098-4b88-8816-43432c4d09bb: deleted successfully Apr 01 08:05:50 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 Apr 01 08:05:50 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:51 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15" returned: 0 in 0.505s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.516s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5', 'name': 'volume-2f393005-0f8a-4a29-9b4b-740aed030d15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e410ee5-6a4d-4e68-8d7b-b58efe66286f', 'enforce_multipath': True} {{(pid=82084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eb5208-aa3c-4d98-aac7-97323e316c46]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-3a4a453a-a6f6-4f75-bd2c-30a64a2a3965 req-210220ea-1a22-44b4-a5aa-d076b30bece1 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] attachment_update completed successfully. Apr 01 08:05:51 devstack sudo[84334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e Apr 01 08:05:51 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Creating offline snapshot 1dab5fa5-e077-43bb-a145-571c2a1d9872 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[360fad23-26c2-444f-884f-9a89b302c946]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:51 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:05:51 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:52 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e" returned: 0 in 0.706s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:52 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e Apr 01 08:05:52 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:52 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.626s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:52 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 1G Apr 01 08:05:52 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:52 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-14435bf6-c351-481e-89f7-ff514265e24e" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-14435bf6-c351-481e-89f7-ff514265e24e" released by "delete_volume" :: held 1.239s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" acquired by "delete_volume" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32cc581-55b3-4629-a08b-99b9dd2ca720]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:52 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 Apr 01 08:05:52 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:52 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 1G" returned: 0 in 0.577s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:52 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 Apr 01 08:05:52 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:53 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71" returned: 0 in 0.900s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:53 devstack sudo[84399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71 Apr 01 08:05:53 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:53 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872" returned: 0 in 0.799s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:53 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 is being set with open permissions: ugo+rw Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:53 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 Apr 01 08:05:53 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Flow 'volume_create_manager' (6e68795a-49fd-453f-9ea5-a7257432246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ba3a29-2129-4278-8e85-be87248bf941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ba3a29-2129-4278-8e85-be87248bf941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414128029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2f2fdd-d74d-4c75-944e-3b03386f972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11940875aa904fed91013d2fbfff315c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:54Z,use_quota=True,user_id='83692af35a8c452db088d64146572e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d178cd3d-98e0-4eaf-b811-42eb3a5088fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d178cd3d-98e0-4eaf-b811-42eb3a5088fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3318b2c-c995-4292-ad49-7fec265c824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3318b2c-c995-4292-ad49-7fec265c824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2f2fdd-d74d-4c75-944e-3b03386f972a', 'volume_name': 'volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4186c91a-40a7-4565-8d46-f49e3cc70805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4186c91a-40a7-4565-8d46-f49e3cc70805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f68bbf-6385-4965-a860-11460ee0f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:53 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Volume 3b2f2fdd-d74d-4c75-944e-3b03386f972a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a', 'volume_size': 1} Apr 01 08:05:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:54 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65e91b96-4253-425e-a671-3c64baea8d71" returned: 0 in 0.648s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-65e91b96-4253-425e-a671-3c64baea8d71" released by "delete_volume" :: held 1.578s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:54 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['6733f2de-d6bd-4590-8315-6e25c146c3ec'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414128029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2f2fdd-d74d-4c75-944e-3b03386f972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11940875aa904fed91013d2fbfff315c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:54Z,use_quota=True,user_id='83692af35a8c452db088d64146572e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Creating volume 3b2f2fdd-d74d-4c75-944e-3b03386f972a {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:54 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d0f77588-0872-48e2-8ce0-c83ae48464b8 tempest-SnapshotsActionsTest-1143479745 None] Create snapshot completed successfully Apr 01 08:05:54 devstack cinder-volume[82084]: WARNING cinder.quota [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2008257162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2008257162, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:05:54 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a 1073741824 Apr 01 08:05:54 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['2b005dea-5744-4c7a-9064-0751c4016160', 'e73bfba7-374f-4a52-88c1-debc94aa32a4', 'd1b8082a-7d25-431b-a20b-6dd4faee3d57', 'b009bf20-736d-43c4-a365-ccaf37518182'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['d3848fcf-c9cc-4f1b-9c07-40205b638f11', 'c27162a8-8d43-4151-960a-2dedd82b3bc7', 'f67a1ef8-1be0-48b5-8811-29c4491463c4', '63035ed0-2c25-4f9c-bde9-17e2545b7997'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:54 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:54 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:55 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.556s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-96e5f05c-675d-4afa-b9b5-2eb64409b3b9 tempest-GroupSnapshotsTest-863375310 None] Delete group completed successfully. Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-1dab5fa5-e077-43bb-a145-571c2a1d9872-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-1dab5fa5-e077-43bb-a145-571c2a1d9872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-1dab5fa5-e077-43bb-a145-571c2a1d9872" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-1dab5fa5-e077-43bb-a145-571c2a1d9872" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Deleting offline snapshot 1dab5fa5-e077-43bb-a145-571c2a1d9872 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] snapshot_file for this snap is: volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-33f70c71-fa08-4a12-bd45-08a9a6f7953b tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-2063611797: creating Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[79186760-92c3-4314-8759-64083d75ae03]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-33f70c71-fa08-4a12-bd45-08a9a6f7953b tempest-GroupSnapshotsTest-863375310 None] Group tempest-GroupSnapshotsTest-Group-2063611797: created successfully Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-33f70c71-fa08-4a12-bd45-08a9a6f7953b tempest-GroupSnapshotsTest-863375310 None] Create group completed successfully. Apr 01 08:05:55 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a 1073741824" returned: 0 in 1.059s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:55 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a Apr 01 08:05:55 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:55 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 Apr 01 08:05:55 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:55 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f68bbf-6385-4965-a860-11460ee0f71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a8d9f-663a-469c-a390-15096a8ae02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Volume volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a (3b2f2fdd-d74d-4c75-944e-3b03386f972a): created successfully Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a8d9f-663a-469c-a390-15096a8ae02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Flow 'volume_create_manager' (6e68795a-49fd-453f-9ea5-a7257432246e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-be9408a0-b352-4ff2-8a39-6f3e793e9938 tempest-ServersNegativeTestJSON-86645066 None] Created volume successfully. Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:55 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872" returned: 0 in 0.554s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:55 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:05:55 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3596b9b-5fee-46bc-879c-89b906b0af26]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:55 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:05:55 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:56 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.712s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:05:56 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.879s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:05:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:56 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 Apr 01 08:05:56 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (acfe5e08-e12d-4240-ba2f-34f11aca1f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9977a6-8b28-4a14-ba12-4f658d953147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9977a6-8b28-4a14-ba12-4f658d953147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577608817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6503470-aa4f-4997-865e-2e901dfd589e,host='devstack@QuobyteHD#QuobyteHD',id=68515503-d0a6-4d0c-be98-b5f5d123ba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:57Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d88a8ae5-273a-4255-ad03-be2a600cfd2c),volume_type_id=d88a8ae5-273a-4255-ad03-be2a600cfd2c)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c401b21-2f65-42d3-b9d8-4ce88fa9a7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c401b21-2f65-42d3-b9d8-4ce88fa9a7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb809c71-9064-48fe-af83-7b2527b72819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb809c71-9064-48fe-af83-7b2527b72819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68515503-d0a6-4d0c-be98-b5f5d123ba73', 'volume_name': 'volume-68515503-d0a6-4d0c-be98-b5f5d123ba73', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2013dc5-27a4-488f-a0d9-1ec084f59426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2013dc5-27a4-488f-a0d9-1ec084f59426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663605d-6700-4d26-a0db-8af43a896b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Volume 68515503-d0a6-4d0c-be98-b5f5d123ba73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68515503-d0a6-4d0c-be98-b5f5d123ba73', 'volume_size': 1} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6503470-aa4f-4997-865e-2e901dfd589e,created_at=2026-04-01T06:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1577608817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6503470-aa4f-4997-865e-2e901dfd589e,host='devstack@QuobyteHD#QuobyteHD',id=68515503-d0a6-4d0c-be98-b5f5d123ba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5a390a19bd4e40a802e868af2cd8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:57Z,use_quota=True,user_id='a567c28ecdbe4ebeba823f177b747f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d88a8ae5-273a-4255-ad03-be2a600cfd2c),volume_type_id=d88a8ae5-273a-4255-ad03-be2a600cfd2c)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Creating volume 68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:57 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:57 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 1073741824 Apr 01 08:05:57 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Flow 'volume_create_manager' (fe8bd835-2c3c-4eb8-9f75-15f1d831026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9b1dd4-c98a-4d58-abab-13c9e55e5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9b1dd4-c98a-4d58-abab-13c9e55e5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1910106785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35180c67-4d64-4928-ba52-9de25f40982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11940875aa904fed91013d2fbfff315c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:58Z,use_quota=True,user_id='83692af35a8c452db088d64146572e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e2768f-89c5-4feb-8a78-0d2f47c7f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e2768f-89c5-4feb-8a78-0d2f47c7f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70af46-bf86-4020-ab5f-729a1fe185b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70af46-bf86-4020-ab5f-729a1fe185b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35180c67-4d64-4928-ba52-9de25f40982b', 'volume_name': 'volume-35180c67-4d64-4928-ba52-9de25f40982b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ad8348-30ca-425b-af5f-928ec5a5d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ad8348-30ca-425b-af5f-928ec5a5d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40522b3b-70d1-4b03-a86d-e2bc618fb8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Volume 35180c67-4d64-4928-ba52-9de25f40982b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35180c67-4d64-4928-ba52-9de25f40982b', 'volume_size': 1} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:57 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872" returned: 0 in 1.268s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:58 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872 Apr 01 08:05:58 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:58 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 1073741824" returned: 0 in 0.751s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:58 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 Apr 01 08:05:58 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:58 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.1dab5fa5-e077-43bb-a145-571c2a1d9872" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-1dab5fa5-e077-43bb-a145-571c2a1d9872" released by "_delete_snapshot" :: held 3.276s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_snapshot" :: held 3.312s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Created reservations ['d29457cc-f4eb-4608-9106-4655c13e85e8', 'e6bf4f6b-0c88-4b2f-aa90-805e9f8cba32', '23a7a6c8-ed68-4818-9005-71f5ddc91bf7', 'b53734dd-5d38-4497-862e-c0bbccd86185'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:05:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Delete snapshot completed successfully. Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9012e72-e6a7-400c-b452-f7ba7d34459a tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-1dab5fa5-e077-43bb-a145-571c2a1d9872-delete_snapshot" released by "delete_snapshot" :: held 3.407s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:05:58 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73" returned: 0 in 0.536s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1910106785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35180c67-4d64-4928-ba52-9de25f40982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11940875aa904fed91013d2fbfff315c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:05:58Z,use_quota=True,user_id='83692af35a8c452db088d64146572e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Creating volume 35180c67-4d64-4928-ba52-9de25f40982b {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:05:58 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663605d-6700-4d26-a0db-8af43a896b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68515503-d0a6-4d0c-be98-b5f5d123ba73', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77867a63-9765-4876-895d-bf53500e2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:58 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b 1073741824 Apr 01 08:05:58 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Volume volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 (68515503-d0a6-4d0c-be98-b5f5d123ba73): created successfully Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77867a63-9765-4876-895d-bf53500e2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Flow 'volume_create_manager' (acfe5e08-e12d-4240-ba2f-34f11aca1f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-bb0b1da0-a272-4322-800c-0cd286ed5eb6 tempest-GroupSnapshotsTest-863375310 None] Created volume successfully. Apr 01 08:05:59 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b 1073741824" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:59 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b Apr 01 08:05:59 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:59 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.108s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40522b3b-70d1-4b03-a86d-e2bc618fb8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35180c67-4d64-4928-ba52-9de25f40982b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdc9193-7948-438c-8fd5-b0467b56fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:05:59 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Volume volume-35180c67-4d64-4928-ba52-9de25f40982b (35180c67-4d64-4928-ba52-9de25f40982b): created successfully Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdc9193-7948-438c-8fd5-b0467b56fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Flow 'volume_create_manager' (fe8bd835-2c3c-4eb8-9f75-15f1d831026d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:05:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] GroupSnapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: creating. Apr 01 08:05:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ce46e684-0fa0-41c6-ad0f-25bd28f42992 tempest-ServersNegativeTestJSON-86645066 None] Created volume successfully. Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Group snapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: creating. {{(pid=82084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Creating offline snapshot 604c83b6-4950-499f-abf5-e6401bb27bd7 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3dc10-c7f7-4ab5-ab2e-b6e261699231]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:05:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:05:59 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:05:59 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "cinder-35180c67-4d64-4928-ba52-9de25f40982b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-35180c67-4d64-4928-ba52-9de25f40982b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "cinder-quobyte-35180c67-4d64-4928-ba52-9de25f40982b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-quobyte-35180c67-4d64-4928-ba52-9de25f40982b" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3ca24-2875-4ca2-964d-2b73d824e651]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:00 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b Apr 01 08:06:00 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:00 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.666s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:00 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 1G Apr 01 08:06:00 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:00 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b" returned: 0 in 0.625s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:01 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b Apr 01 08:06:01 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:01 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 1G" returned: 0 in 0.633s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:01 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 Apr 01 08:06:01 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:01 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-35180c67-4d64-4928-ba52-9de25f40982b" returned: 0 in 0.477s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-quobyte-35180c67-4d64-4928-ba52-9de25f40982b" released by "delete_volume" :: held 1.126s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Created reservations ['addb9a91-8a19-4320-aa6d-319d9a1e158b', '7ebf9b02-6f09-4950-84b0-641616cc920a', '6c17f8fd-27e2-45ab-8033-579355a98321', 'fbf4caa8-02e7-47fd-9f23-e1c924432028'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:01 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:01 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:01 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 is being set with open permissions: ugo+rw Apr 01 08:06:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:01 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 Apr 01 08:06:01 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:02 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.493s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Deleted volume successfully. Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d41f720c-26f6-4e31-97e0-5d2a659be12a tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-35180c67-4d64-4928-ba52-9de25f40982b-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:02 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7" returned: 0 in 0.583s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.395s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Creating offline snapshot dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed of volume 68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[998e6c9c-4fc4-4250-bc44-d4478d322244]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d0d3e4a0-82c5-44b3-9d70-4f33bcc06fbc tempest-SnapshotsActionsTest-1143479745 None] Create snapshot completed successfully Apr 01 08:06:02 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 Apr 01 08:06:02 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "cinder-3b2f2fdd-d74d-4c75-944e-3b03386f972a-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-3b2f2fdd-d74d-4c75-944e-3b03386f972a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "cinder-quobyte-3b2f2fdd-d74d-4c75-944e-3b03386f972a" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-quobyte-3b2f2fdd-d74d-4c75-944e-3b03386f972a" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[387db158-d6f0-4492-b829-ac809c3c907b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:02 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a Apr 01 08:06:02 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:02 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:02 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed 1G Apr 01 08:06:02 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-604c83b6-4950-499f-abf5-e6401bb27bd7-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-604c83b6-4950-499f-abf5-e6401bb27bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-604c83b6-4950-499f-abf5-e6401bb27bd7" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-604c83b6-4950-499f-abf5-e6401bb27bd7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Deleting offline snapshot 604c83b6-4950-499f-abf5-e6401bb27bd7 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] snapshot_file for this snap is: volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bacee5-8c17-44f1-ac68-f668b3e205ea]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:02 devstack sudo[84918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 Apr 01 08:06:02 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:03 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a" returned: 0 in 0.636s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:03 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a Apr 01 08:06:03 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:03 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed 1G" returned: 0 in 0.716s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:03 devstack sudo[84928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed Apr 01 08:06:03 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:03 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7" returned: 0 in 0.645s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08d06e-03b8-41d3-a6a1-540bcac40683]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:03 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3b2f2fdd-d74d-4c75-944e-3b03386f972a" returned: 0 in 0.460s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-quobyte-3b2f2fdd-d74d-4c75-944e-3b03386f972a" released by "delete_volume" :: held 1.129s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:03 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:03 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Created reservations ['f8fce318-59f8-4fc6-84cb-c0310f0e5a29', '3d2c02b3-97a8-46c7-ad5a-a53a6fe97eb8', 'c142ef4b-de00-455d-866a-cdc872482dd8', '75512245-b2aa-4d2d-94ec-53c61ddac251'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:03 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:03 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:03 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:03 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:06:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:03 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed Apr 01 08:06:03 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:04 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.482s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:04 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 Apr 01 08:06:04 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:04 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Deleted volume successfully. Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5796c56c-7b1d-4204-8fd7-963dd15d37ba tempest-ServersNegativeTestJSON-86645066 None] Lock "cinder-3b2f2fdd-d74d-4c75-944e-3b03386f972a-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:04 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" returned: 0 in 0.532s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:04 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info Apr 01 08:06:04 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:04 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7" returned: 0 in 0.572s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:04 devstack sudo[84980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7 Apr 01 08:06:04 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:04 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info" returned: 0 in 0.545s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:04 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:06:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:05 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info Apr 01 08:06:05 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:05 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.604c83b6-4950-499f-abf5-e6401bb27bd7" returned: 0 in 0.468s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-604c83b6-4950-499f-abf5-e6401bb27bd7" released by "_delete_snapshot" :: held 2.229s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_snapshot" :: held 2.260s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Created reservations ['0fa97de8-56fb-4892-aa04-0d7a78bdea66', 'be420a95-f43e-43a2-9deb-17522c8b895b', '882b84d5-3a16-4ce2-bd92-995ceff69413', 'e49a75e6-96b8-48a4-a0f8-f9f650b9fcf6'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Delete snapshot completed successfully. Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dbc11faf-f7d8-489f-b0dd-d105e707eb8b tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-604c83b6-4950-499f-abf5-e6401bb27bd7-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:05 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.info" returned: 0 in 0.455s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.210s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c0f20137-876f-4471-94ed-d070160cbbb7 tempest-GroupSnapshotsTest-863375310 None] group_snapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: created successfully Apr 01 08:06:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] group_snapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: deleting Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] group_snapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: deleting {{(pid=82084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Deleting offline snapshot dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed of volume 68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] snapshot_file for this snap is: volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[113353c6-3e1a-4a6e-9568-afc98316605e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Creating offline snapshot a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:06:06 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed Apr 01 08:06:06 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b040ff6f-bc4b-4536-95c7-83a86e740d85]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:06 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:06 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:06 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" returned: 0 in 0.498s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68515503-d0a6-4d0c-be98-b5f5d123ba73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b569b7-fc68-4b66-a503-564aefd5856a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:06 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 Apr 01 08:06:06 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:06 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.519s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:07 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 1G Apr 01 08:06:07 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:07 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73" returned: 0 in 0.564s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:07 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed Apr 01 08:06:07 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:07 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 1G" returned: 0 in 0.586s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:07 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 Apr 01 08:06:07 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:07 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:07 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed Apr 01 08:06:07 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:08 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" returned: 0 in 0.460s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:08 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 is being set with open permissions: ugo+rw Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:08 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 Apr 01 08:06:08 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:08 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73.dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" returned: 0 in 0.420s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-dda194f2-fcb6-4768-8ccd-bf3d9d6b70ed" released by "_delete_snapshot" :: held 2.042s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" released by "delete_snapshot" :: held 2.065s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:08 devstack cinder-volume[82084]: WARNING cinder.quota [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-657340083 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-657340083, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:08 devstack cinder-volume[82084]: WARNING cinder.quota [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-657340083 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-657340083, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] Created reservations ['7ee2ea7c-6099-4105-81d4-d5825191cee4', 'bc9732cf-24d6-4207-9566-e2eae8498af0', '8c669523-8e7d-4b94-8ce3-3d8f595d22fb', 'e97817fe-1987-42e3-ae05-5feffb6c9e55'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-98b33dae-fa4f-4f1e-9954-87a66b12f1cd tempest-GroupSnapshotsTest-863375310 None] group_snapshot 9508cae1-b8fe-4087-8766-7e6e8299f1be: deleted successfully Apr 01 08:06:08 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-850d1c20-d6b0-43b1-95eb-b90eaa2b6faf tempest-SnapshotsActionsTest-1143479745 None] Create snapshot completed successfully Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36002d-9cd8-4bb6-a236-e7c4c2c3106d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:08 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 Apr 01 08:06:08 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:09 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73" returned: 0 in 0.508s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:09 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73 Apr 01 08:06:09 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Deleting offline snapshot a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] snapshot_file for this snap is: volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[934bcf3e-b714-444f-9226-01457fb8944c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:09 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68515503-d0a6-4d0c-be98-b5f5d123ba73" returned: 0 in 0.468s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Lock "cinder-quobyte-68515503-d0a6-4d0c-be98-b5f5d123ba73" released by "delete_volume" :: held 1.015s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:09 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 Apr 01 08:06:09 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['d61da1e6-4b01-4461-9196-5fb0ccc2217b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:09 devstack cinder-volume[82084]: WARNING cinder.quota [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-657340083 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-657340083, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Created reservations ['e760d45d-fd46-4d86-baf0-a8663e5a9e39', 'f2095c3e-5068-4cc2-996e-1608e535c864', '085b7e42-c595-44bd-a8de-a6cab8220fbf', '12c7fbba-8f7c-4006-9c01-1181b65574ba'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:09 devstack sudo[85092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:09 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:10 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b860c4b-7883-4508-952c-68be14b25b9c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:10 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:10 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:10 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-8249823f-dcef-485c-89cf-22aa161d3f70 tempest-GroupSnapshotsTest-863375310 None] Delete group completed successfully. Apr 01 08:06:10 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.593s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:10 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 Apr 01 08:06:10 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:11 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" returned: 0 in 0.755s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:11 devstack sudo[85138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9 Apr 01 08:06:11 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:12 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" returned: 0 in 0.560s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9" released by "_delete_snapshot" :: held 2.461s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_snapshot" :: held 2.477s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:12 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Created reservations ['96e6ad94-d92c-4111-9753-e35ca2d2e4fa', 'bb476613-2fa6-40cc-aece-3c7194fafe5d', '08199ab2-6b25-4e27-9fc3-cce8abce6172', '5d4ce3a9-07c4-400a-913f-e7d266ab52dd'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:12 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Delete snapshot completed successfully. Apr 01 08:06:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-095faa77-6b89-4526-998a-81598afe4afd tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-a1d3e209-63c0-4eff-8e9f-1b8be502f9c9-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Creating offline snapshot a9849f28-acb5-4888-9907-4f575b261bd7 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aad6e6-8301-467b-8815-bd759c6e9c4f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:13 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:13 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:13 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.620s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:13 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 1G Apr 01 08:06:13 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:14 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 1G" returned: 0 in 1.117s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:14 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 Apr 01 08:06:14 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:15 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7" returned: 0 in 0.747s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:15 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 is being set with open permissions: ugo+rw Apr 01 08:06:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:15 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 Apr 01 08:06:15 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:16 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7" returned: 0 in 0.641s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:16 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ed3457bf-ba21-4f27-af0e-7c97f0b2f1b5 tempest-SnapshotsActionsTest-1143479745 None] Create snapshot completed successfully Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-a9849f28-acb5-4888-9907-4f575b261bd7-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-a9849f28-acb5-4888-9907-4f575b261bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Acquiring lock "cinder-quobyte-a9849f28-acb5-4888-9907-4f575b261bd7" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-a9849f28-acb5-4888-9907-4f575b261bd7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Deleting offline snapshot a9849f28-acb5-4888-9907-4f575b261bd7 of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] snapshot_file for this snap is: volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085d295-2a9f-4b5a-930a-43b5c940e56c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:17 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 Apr 01 08:06:17 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:18 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7" returned: 0 in 0.799s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[14088a46-5ce5-4517-ab8e-f9c8b095743d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:18 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:18 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:18 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.594s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:18 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 Apr 01 08:06:18 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:19 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7" returned: 0 in 0.599s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:19 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7 Apr 01 08:06:19 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:19 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.a9849f28-acb5-4888-9907-4f575b261bd7" returned: 0 in 0.458s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-a9849f28-acb5-4888-9907-4f575b261bd7" released by "_delete_snapshot" :: held 2.512s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_snapshot" :: held 2.532s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:19 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Created reservations ['0b1acffd-1ca3-4279-8393-e75c4d3e4160', '30205521-7279-43eb-9433-e9b987e35601', '408950fe-ea10-414f-b572-f88b08fbcb7f', '1124142e-9366-470c-ae75-2c51e9023668'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Delete snapshot completed successfully. Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-27f35795-4f28-433f-b9e8-276bc480f9fe tempest-SnapshotsActionsTest-787312958 None] Lock "cinder-a9849f28-acb5-4888-9907-4f575b261bd7-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-70bd353e-4e27-4992-91d6-f8bf8d4ccb51 tempest-GroupSnapshotsV319Test-409834683 None] Group tempest-GroupSnapshotsV319Test-Group-1411531301: creating Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=144,cinder:INSERT=38,cinder:UPDATE=158,cinder:DELETE=6 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:06:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-70bd353e-4e27-4992-91d6-f8bf8d4ccb51 tempest-GroupSnapshotsV319Test-409834683 None] Group tempest-GroupSnapshotsV319Test-Group-1411531301: created successfully Apr 01 08:06:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-70bd353e-4e27-4992-91d6-f8bf8d4ccb51 tempest-GroupSnapshotsV319Test-409834683 None] Create group completed successfully. Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "cinder-7acd8d35-482a-4376-aa40-78bb06aa2f3b-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-7acd8d35-482a-4376-aa40-78bb06aa2f3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "cinder-quobyte-7acd8d35-482a-4376-aa40-78bb06aa2f3b" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-7acd8d35-482a-4376-aa40-78bb06aa2f3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Deleting offline snapshot 7acd8d35-482a-4376-aa40-78bb06aa2f3b of volume 8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] snapshot_file for this snap is: volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089ac0e-1a01-4735-8793-4aa7f8cb080c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:21 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:21 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:21 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.512s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[331345fc-e436-404e-be4d-8aa1be98d83b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:21 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd Apr 01 08:06:21 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:22 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" returned: 0 in 0.581s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:22 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:22 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=135,cinder:SELECT=147,cinder:INSERT=33,cinder:DELETE=8 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Flow 'volume_create_manager' (9fba8fc6-6d64-4c2e-8abe-b062b0bd2ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7aac6-a8a5-4ffb-98c6-ea4333d3bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea7aac6-a8a5-4ffb-98c6-ea4333d3bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135029375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9139787-01ff-4516-b321-13dad2d9a356,host='devstack@QuobyteHD#QuobyteHD',id=fa87708e-68c6-4486-9b4b-5ea31afb1950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4071a7c70bfb418d96bf53e24e7949b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:22Z,use_quota=True,user_id='3f612d7de15a494f8af2a33b0f397783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f20bf252-9f17-4c43-874c-f916381f0c3f),volume_type_id=f20bf252-9f17-4c43-874c-f916381f0c3f)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc4958-442d-4446-8286-95b898493f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc4958-442d-4446-8286-95b898493f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9fe864-cc3c-48e2-9ed8-1858dc2660dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9fe864-cc3c-48e2-9ed8-1858dc2660dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa87708e-68c6-4486-9b4b-5ea31afb1950', 'volume_name': 'volume-fa87708e-68c6-4486-9b4b-5ea31afb1950', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff1ff82-eb6d-41a0-a32f-463fff147173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff1ff82-eb6d-41a0-a32f-463fff147173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfddcdc6-edcf-4944-8250-19edad7809a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:22 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Volume fa87708e-68c6-4486-9b4b-5ea31afb1950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa87708e-68c6-4486-9b4b-5ea31afb1950', 'volume_size': 1} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9139787-01ff-4516-b321-13dad2d9a356,created_at=2026-04-01T06:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135029375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9139787-01ff-4516-b321-13dad2d9a356,host='devstack@QuobyteHD#QuobyteHD',id=fa87708e-68c6-4486-9b4b-5ea31afb1950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4071a7c70bfb418d96bf53e24e7949b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:22Z,use_quota=True,user_id='3f612d7de15a494f8af2a33b0f397783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f20bf252-9f17-4c43-874c-f916381f0c3f),volume_type_id=f20bf252-9f17-4c43-874c-f916381f0c3f)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Creating volume fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:22 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:22 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 1073741824 Apr 01 08:06:22 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:22 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.533s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:22 devstack sudo[85284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b Apr 01 08:06:22 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:22 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 1073741824" returned: 0 in 0.601s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:22 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 Apr 01 08:06:22 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:23 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd.7acd8d35-482a-4376-aa40-78bb06aa2f3b" returned: 0 in 0.577s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-7acd8d35-482a-4376-aa40-78bb06aa2f3b" released by "_delete_snapshot" :: held 2.272s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_snapshot" :: held 2.300s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Created reservations ['d9708e6e-97f3-4e15-baca-3d85f2d9a0a6', '7f814b6b-b136-439a-8cd5-b88a3ebdc7fa', 'aecb0c2a-22db-4ab8-ab42-1ce4bccd85e3', '9a4d2bd6-99fc-47b7-8493-8772edb94ea0'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Delete snapshot completed successfully. Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-daf1b41f-c76d-4dd2-92f1-800a73287e06 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-7acd8d35-482a-4376-aa40-78bb06aa2f3b-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:23 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950" returned: 0 in 0.500s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfddcdc6-edcf-4944-8250-19edad7809a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa87708e-68c6-4486-9b4b-5ea31afb1950', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc0903-6d4e-4fee-b2ca-0e48b45d1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:23 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Volume volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 (fa87708e-68c6-4486-9b4b-5ea31afb1950): created successfully Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc0903-6d4e-4fee-b2ca-0e48b45d1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Flow 'volume_create_manager' (9fba8fc6-6d64-4c2e-8abe-b062b0bd2ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-da89ba3e-750b-43c6-9b89-0f100567e3c2 tempest-GroupSnapshotsV319Test-409834683 None] Created volume successfully. Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "cinder-8aa030d6-2649-4d6d-ae5e-fbaef26391dd-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-8aa030d6-2649-4d6d-ae5e-fbaef26391dd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb2edc2-9dd9-450d-b07c-2cb1a07cbf2d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:24 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd Apr 01 08:06:24 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:24 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] GroupSnapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: creating. Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Group snapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: creating. {{(pid=82084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Creating offline snapshot 07910b2c-685f-41fa-9804-930bc8c564ce of volume fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581812c-8c81-42ab-85d6-70fa43df30ac]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:24 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 Apr 01 08:06:24 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:24 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" returned: 0 in 0.651s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:24 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd Apr 01 08:06:24 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:25 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950" returned: 0 in 0.655s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:25 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce 1G Apr 01 08:06:25 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:25 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" returned: 0 in 0.471s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-quobyte-8aa030d6-2649-4d6d-ae5e-fbaef26391dd" released by "delete_volume" :: held 1.155s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Created reservations ['8b795763-8ae7-4a14-92ee-d416cb4c58a1', 'ff510b8b-6045-4c95-81c3-bd277b9cbba1', 'b5735169-e844-4174-95c8-8ed9a90e112e', '6721e88f-75fb-4e7f-98b9-627eda778a72'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:25 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:25 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:25 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce 1G" returned: 0 in 0.592s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:25 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce Apr 01 08:06:25 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:25 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.542s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:25 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:25 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Deleted volume successfully. Apr 01 08:06:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ce2d99fe-8e88-4fa7-9ee5-3d28d8801310 tempest-SnapshotsActionsTest-1143479745 None] Lock "cinder-8aa030d6-2649-4d6d-ae5e-fbaef26391dd-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:26 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:26 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:06:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:26 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce Apr 01 08:06:26 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:26 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce" returned: 0 in 0.429s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:26 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info Apr 01 08:06:26 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:27 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info" returned: 0 in 0.465s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:27 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info is being set with open permissions: ugo+rw: NotImplementedError Apr 01 08:06:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:27 devstack sudo[85342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info Apr 01 08:06:27 devstack sudo[85342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:27 devstack sudo[85342]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.info" returned: 0 in 0.503s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:27 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6f58b25d-4167-48fb-b91e-7bcb78739daa tempest-GroupSnapshotsV319Test-409834683 None] group_snapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: created successfully Apr 01 08:06:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] group_snapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: deleting Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] group_snapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: deleting {{(pid=82084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "cinder-quobyte-07910b2c-685f-41fa-9804-930bc8c564ce" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-07910b2c-685f-41fa-9804-930bc8c564ce" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Deleting offline snapshot 07910b2c-685f-41fa-9804-930bc8c564ce of volume fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] snapshot_file for this snap is: volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe3857-c0c5-423a-971f-d0b0dd2ba7f6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:29 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce Apr 01 08:06:29 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:30 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce" returned: 0 in 0.910s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa87708e-68c6-4486-9b4b-5ea31afb1950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c91e62-88bd-4e19-b655-c732ab4ba589]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:30 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 Apr 01 08:06:30 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:30 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950" returned: 0 in 0.699s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:30 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce Apr 01 08:06:30 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:31 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce" returned: 0 in 0.584s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:31 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce Apr 01 08:06:31 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:32 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950.07910b2c-685f-41fa-9804-930bc8c564ce" returned: 0 in 0.567s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-07910b2c-685f-41fa-9804-930bc8c564ce" released by "_delete_snapshot" :: held 2.851s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" released by "delete_snapshot" :: held 2.868s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:32 devstack cinder-volume[82084]: WARNING cinder.quota [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1687454085 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1687454085, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:32 devstack cinder-volume[82084]: WARNING cinder.quota [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1687454085 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1687454085, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] Created reservations ['20288233-93bc-4d46-bbe7-bc0a7084c137', '707e4a21-5f2f-44e5-84dc-d45cd07c9467', '23917175-ebc9-4171-b540-3c7e554fff04', '50766cb5-f1f5-4812-a542-72caac363ea4'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-871964ac-3a6a-41dc-bfe9-32161e350011 tempest-GroupSnapshotsV319Test-409834683 None] group_snapshot 460d0654-b116-4da8-ad9f-dae6007a40ac: deleted successfully Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" acquired by "delete_volume" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd277ab3-eabe-4299-a5fd-45b023668dc2]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:32 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 Apr 01 08:06:32 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:33 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950" returned: 0 in 0.658s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:33 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950 Apr 01 08:06:33 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:33 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa87708e-68c6-4486-9b4b-5ea31afb1950" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Lock "cinder-quobyte-fa87708e-68c6-4486-9b4b-5ea31afb1950" released by "delete_volume" :: held 1.127s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Created reservations ['87f62739-4762-47c6-b484-d25fe611d10d'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:34 devstack cinder-volume[82084]: WARNING cinder.quota [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1687454085 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1687454085, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Created reservations ['9ef830e8-4b20-4509-8199-c3e47b483616', '369b6949-0c4f-4620-a11c-fcd3cfd3dde1', '6b63dd5f-84a2-4a34-9336-fa7d33bb521a', '372bcf86-399e-44df-b79a-fb379e7e5516'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:34 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:34 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:34 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.471s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:34 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2aef8016-d7f7-42ce-be50-13734369c644 tempest-GroupSnapshotsV319Test-409834683 None] Delete group completed successfully. Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Flow 'volume_create_manager' (4f64999d-3c24-4a65-b088-6647121d09bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb1f558-f9f0-4192-a7b6-f1ba628c53b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb1f558-f9f0-4192-a7b6-f1ba628c53b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-692079471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbd8ebd-f5c9-42b5-a04b-506e19c6e313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238aea58c70044519ca662a6944e3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:35Z,use_quota=True,user_id='33f5388e9fa94a3ab4d154d420850b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a5e743-7efd-4ffb-8830-a8f2a84a6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a5e743-7efd-4ffb-8830-a8f2a84a6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535a1dd9-0534-4f1e-a691-3379fe33bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535a1dd9-0534-4f1e-a691-3379fe33bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbd8ebd-f5c9-42b5-a04b-506e19c6e313', 'volume_name': 'volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b20dc-7238-42fd-b664-818c4200e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b20dc-7238-42fd-b664-818c4200e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc58d7fe-b990-4f61-8214-ebed1a61d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:35 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Volume dbbd8ebd-f5c9-42b5-a04b-506e19c6e313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313', 'volume_size': 1} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-692079471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbd8ebd-f5c9-42b5-a04b-506e19c6e313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238aea58c70044519ca662a6944e3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:35Z,use_quota=True,user_id='33f5388e9fa94a3ab4d154d420850b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Creating volume dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:35 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:35 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 1073741824 Apr 01 08:06:35 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:35 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 1073741824" returned: 0 in 0.551s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:35 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 Apr 01 08:06:35 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:36 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" returned: 0 in 0.582s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc58d7fe-b990-4f61-8214-ebed1a61d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d0ced5-4665-4750-b948-8b8faca181d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Volume volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 (dbbd8ebd-f5c9-42b5-a04b-506e19c6e313): created successfully Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d0ced5-4665-4750-b948-8b8faca181d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Flow 'volume_create_manager' (4f64999d-3c24-4a65-b088-6647121d09bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Flow 'volume_create_manager' (fb85faab-3b1c-4630-8793-c0ce0c372867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f07e6b2-71b0-4b6f-8d8d-8bb567e01175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-18af5c7f-bd81-4d6b-b124-ae26971fe8d1 tempest-AbsoluteLimitsTests-1317280540 None] Created volume successfully. Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f07e6b2-71b0-4b6f-8d8d-8bb567e01175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1646695394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f6de68-f153-4d87-b9b3-d24ae1cceaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9efbcbb95cc4bf393aa30f7a1be1a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:36Z,use_quota=True,user_id='7c38bd3a943f4a7cae8facb2f9467d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d72084-408b-473a-9d46-4ee15af299a7),volume_type_id=34d72084-408b-473a-9d46-4ee15af299a7)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf4f926-6d8a-48d6-8581-85e9ec2a7774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf4f926-6d8a-48d6-8581-85e9ec2a7774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9869ec2-1206-4852-9087-5cc92535ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9869ec2-1206-4852-9087-5cc92535ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f6de68-f153-4d87-b9b3-d24ae1cceaf2', 'volume_name': 'volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f71cd4a-8edf-435d-9b30-557d3971a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f71cd4a-8edf-435d-9b30-557d3971a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f322ad-9845-4983-a9a0-73bad0b81373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:36 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Volume b7f6de68-f153-4d87-b9b3-d24ae1cceaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2', 'volume_size': 1} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1646695394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f6de68-f153-4d87-b9b3-d24ae1cceaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9efbcbb95cc4bf393aa30f7a1be1a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:36Z,use_quota=True,user_id='7c38bd3a943f4a7cae8facb2f9467d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d72084-408b-473a-9d46-4ee15af299a7),volume_type_id=34d72084-408b-473a-9d46-4ee15af299a7)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Creating volume b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:36 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:36 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 1073741824 Apr 01 08:06:36 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:37 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 1073741824" returned: 0 in 0.630s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:37 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 Apr 01 08:06:37 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Acquiring lock "cinder-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "cinder-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Acquiring lock "cinder-quobyte-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "cinder-quobyte-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7933c-d919-421c-bb64-5a506c3830be]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:37 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 Apr 01 08:06:37 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:37 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" returned: 0 in 0.595s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f322ad-9845-4983-a9a0-73bad0b81373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5921d8ca-650d-4a29-9f35-e5ab084a9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:37 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Volume volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 (b7f6de68-f153-4d87-b9b3-d24ae1cceaf2): created successfully Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5921d8ca-650d-4a29-9f35-e5ab084a9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Flow 'volume_create_manager' (fb85faab-3b1c-4630-8793-c0ce0c372867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:37 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-53de8dd5-23c5-4845-8fe9-7381dc8d1d5f tempest-VolumeTypesAccessTest-964776486 None] Created volume successfully. Apr 01 08:06:38 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" returned: 0 in 0.593s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:38 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313 Apr 01 08:06:38 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Acquiring lock "cinder-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "cinder-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:38 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" returned: 0 in 0.590s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "cinder-quobyte-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313" released by "delete_volume" :: held 1.241s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Acquiring lock "cinder-quobyte-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "cinder-quobyte-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cfee6-981e-4a45-afe5-3bcd1e5498b3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Created reservations ['caffcc06-a24b-4178-a4cb-012491b5abc3', 'b9385420-d29a-4250-9933-9f716e482082', '2a1a1e69-a722-47cc-9181-8407fb52965d', '9365d464-5c96-475f-b723-ee84a6aef795'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:38 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:38 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:38 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 Apr 01 08:06:38 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d09ceba2-aba4-42e8-9ba3-c094be3d9708 tempest-GroupsV320Test-1624735574 None] Group tempest-GroupsV320Test-Group-1976412856: creating Apr 01 08:06:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d09ceba2-aba4-42e8-9ba3-c094be3d9708 tempest-GroupsV320Test-1624735574 None] Group tempest-GroupsV320Test-Group-1976412856: created successfully Apr 01 08:06:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d09ceba2-aba4-42e8-9ba3-c094be3d9708 tempest-GroupsV320Test-1624735574 None] Create group completed successfully. Apr 01 08:06:39 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:39 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Deleted volume successfully. Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2ce9dfbe-ca8b-4c2a-bd48-cbb3f60b336d tempest-AbsoluteLimitsTests-1317280540 None] Lock "cinder-dbbd8ebd-f5c9-42b5-a04b-506e19c6e313-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:39 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" returned: 0 in 0.654s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:39 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2 Apr 01 08:06:39 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:39 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" returned: 0 in 0.511s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "cinder-quobyte-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2" released by "delete_volume" :: held 1.207s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:39 devstack cinder-volume[82084]: WARNING cinder.quota [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1674456073 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1674456073, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:39 devstack cinder-volume[82084]: WARNING cinder.quota [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1674456073 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1674456073, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:06:39 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Created reservations ['9c2f9c07-6cd1-41d0-8565-655ec92dec60', '364c5f83-6d32-48ab-b0c8-541dd4be05c4', 'ae4d9f51-7997-4299-bc12-fdd56bd01553', '05a4d231-e2cb-43e3-917c-89e0fbd24148'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:40 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:40 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Created reservations ['f631ffcc-7960-439e-811f-84e24583ab86'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:40 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:40 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:40 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.706s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Deleted volume successfully. Apr 01 08:06:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-da1f5bc5-ecb6-47c0-a8a1-fea002e2aadc tempest-VolumeTypesAccessTest-964776486 None] Lock "cinder-b7f6de68-f153-4d87-b9b3-d24ae1cceaf2-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:41 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.794s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:41 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:41 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4d183941-127d-4393-b6bb-d73203a0c4b3 tempest-GroupsV320Test-1624735574 None] Delete group completed successfully. Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (b9f3ff04-5fe8-4a9e-9742-aed1cb1b5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c0f215-4f99-4d08-bde3-f3b9e6b02636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c0f215-4f99-4d08-bde3-f3b9e6b02636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1747558791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb538c54-92fa-4f31-aad0-763e1752b547,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:44Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95506673-4a03-4e47-a5cd-904b7ac12dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95506673-4a03-4e47-a5cd-904b7ac12dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc0eaf9-30c6-448b-a9f9-797d30ae7ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc0eaf9-30c6-448b-a9f9-797d30ae7ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb538c54-92fa-4f31-aad0-763e1752b547', 'volume_name': 'volume-eb538c54-92fa-4f31-aad0-763e1752b547', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9a77e-7ac4-4627-bde4-de588cc72dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9a77e-7ac4-4627-bde4-de588cc72dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2335d1-8d74-41fd-ad18-14d5f32b0146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Volume eb538c54-92fa-4f31-aad0-763e1752b547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb538c54-92fa-4f31-aad0-763e1752b547', 'volume_size': 1} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1747558791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb538c54-92fa-4f31-aad0-763e1752b547,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:44Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Creating volume eb538c54-92fa-4f31-aad0-763e1752b547 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:43 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:43 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 1073741824 Apr 01 08:06:43 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:44 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 1073741824" returned: 0 in 0.806s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:44 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 Apr 01 08:06:44 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:45 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547" returned: 0 in 0.621s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2335d1-8d74-41fd-ad18-14d5f32b0146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb538c54-92fa-4f31-aad0-763e1752b547', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f5112d-8800-49cb-b370-4fa389accb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:45 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Volume volume-eb538c54-92fa-4f31-aad0-763e1752b547 (eb538c54-92fa-4f31-aad0-763e1752b547): created successfully Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f5112d-8800-49cb-b370-4fa389accb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (b9f3ff04-5fe8-4a9e-9742-aed1cb1b5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-48b21633-5109-4c4a-9993-81570b408d0d tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (569cf0cf-b6af-4ca5-b855-67a4b7df59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff6acce-458a-4681-a0e2-5c505482e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff6acce-458a-4681-a0e2-5c505482e04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612271314',display_name='tempest-VolumesGetTest-Volume-2139680154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848acb11-f446-4239-96c1-5e278ff4ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:46Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a50c1a-88bb-4e29-9725-bf022d04f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a50c1a-88bb-4e29-9725-bf022d04f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e743006-c583-456a-9ecf-e145a53f5952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e743006-c583-456a-9ecf-e145a53f5952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848acb11-f446-4239-96c1-5e278ff4ae70', 'volume_name': 'volume-848acb11-f446-4239-96c1-5e278ff4ae70', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02dfe77-e2fb-4b8b-9825-0ec781acf6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02dfe77-e2fb-4b8b-9825-0ec781acf6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419a37dd-d6ab-42d8-b150-2c85ba226a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:46 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Volume 848acb11-f446-4239-96c1-5e278ff4ae70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848acb11-f446-4239-96c1-5e278ff4ae70', 'volume_size': 1} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-612271314',display_name='tempest-VolumesGetTest-Volume-2139680154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848acb11-f446-4239-96c1-5e278ff4ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:46Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Creating volume 848acb11-f446-4239-96c1-5e278ff4ae70 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:46 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:46 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 1073741824 Apr 01 08:06:46 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:47 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 1073741824" returned: 0 in 0.822s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:47 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 Apr 01 08:06:47 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Flow 'volume_create_manager' (7ccd6074-a9fe-4faf-acf0-7eb6e1032721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc2053-0e1e-4331-980b-79c35a1d2fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc2053-0e1e-4331-980b-79c35a1d2fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-900445148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42752c0a-91af-4a67-bf88-0ac4db79e04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc39707cd9c4bee8a16ba9de9cc183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:48Z,use_quota=True,user_id='66c675579e4545d98b566d261388fbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63053e32-47df-43f5-9a10-05c6150bd502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63053e32-47df-43f5-9a10-05c6150bd502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d9ed7f-69fb-4a7b-8840-3553d9382d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d9ed7f-69fb-4a7b-8840-3553d9382d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42752c0a-91af-4a67-bf88-0ac4db79e04e', 'volume_name': 'volume-42752c0a-91af-4a67-bf88-0ac4db79e04e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20237681-6dd2-4160-acb3-f225ba061c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20237681-6dd2-4160-acb3-f225ba061c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f837e324-8689-46e7-b36d-c40c626ebbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume 42752c0a-91af-4a67-bf88-0ac4db79e04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42752c0a-91af-4a67-bf88-0ac4db79e04e', 'volume_size': 1} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:48 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70" returned: 0 in 0.569s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-900445148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42752c0a-91af-4a67-bf88-0ac4db79e04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc39707cd9c4bee8a16ba9de9cc183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:48Z,use_quota=True,user_id='66c675579e4545d98b566d261388fbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Creating volume 42752c0a-91af-4a67-bf88-0ac4db79e04e {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:48 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e 1073741824 Apr 01 08:06:48 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Flow 'volume_create_manager' (e02b797b-0ab9-4417-951b-39f5c5aed3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b534bdd1-2edc-4751-ae47-5635d1e6499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b534bdd1-2edc-4751-ae47-5635d1e6499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df092a8-cac3-4798-9478-65dc83b2b65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69325ee12b343f4ad9dbf36da9ae2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:48Z,use_quota=True,user_id='aca91e3aeca1461caf3ad9e3be6e9d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dc2df8-9b91-4eae-9cd1-96492b5c622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dc2df8-9b91-4eae-9cd1-96492b5c622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d833e741-0d18-4b5b-a200-533892aceacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.image.glance [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Creating Keystone auth plugin from conf {{(pid=82084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419a37dd-d6ab-42d8-b150-2c85ba226a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848acb11-f446-4239-96c1-5e278ff4ae70', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aaa913-a13e-4938-995b-edadf691311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Volume volume-848acb11-f446-4239-96c1-5e278ff4ae70 (848acb11-f446-4239-96c1-5e278ff4ae70): created successfully Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aaa913-a13e-4938-995b-edadf691311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (569cf0cf-b6af-4ca5-b855-67a4b7df59ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-77f683a4-fb53-44b4-818d-ad82d1778d4b tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d833e741-0d18-4b5b-a200-533892aceacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5df092a8-cac3-4798-9478-65dc83b2b65e', 'volume_name': 'volume-5df092a8-cac3-4798-9478-65dc83b2b65e', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631f66c6-bf8d-42c5-b9f4-9bcffe9c1501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631f66c6-bf8d-42c5-b9f4-9bcffe9c1501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74878d79-81b5-46e2-a48a-5712fde76bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume 5df092a8-cac3-4798-9478-65dc83b2b65e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5df092a8-cac3-4798-9478-65dc83b2b65e', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Trying to clone 5df092a8-cac3-4798-9478-65dc83b2b65e from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 at location (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]). {{(pid=82084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 01 08:06:48 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e 1073741824" returned: 0 in 0.629s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:48 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e Apr 01 08:06:48 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:48 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 01 08:06:48 devstack cinder-volume[82084]: INFO cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Image download 20.69 MB at 20.69 MB/s Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf4dca-6370-409b-b5d4-4da86636a50c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-848acb11-f446-4239-96c1-5e278ff4ae70-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "cinder-848acb11-f446-4239-96c1-5e278ff4ae70-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:49 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD Apr 01 08:06:49 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-848acb11-f446-4239-96c1-5e278ff4ae70" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-848acb11-f446-4239-96c1-5e278ff4ae70" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[09203c1e-79e4-42d2-908c-28b0b33c92dd]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:49 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 Apr 01 08:06:49 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:49 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e" returned: 0 in 0.715s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f837e324-8689-46e7-b36d-c40c626ebbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42752c0a-91af-4a67-bf88-0ac4db79e04e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c6f2b6-73e5-4ecb-9743-55c65f79a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:49 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume volume-42752c0a-91af-4a67-bf88-0ac4db79e04e (42752c0a-91af-4a67-bf88-0ac4db79e04e): created successfully Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c6f2b6-73e5-4ecb-9743-55c65f79a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Flow 'volume_create_manager' (7ccd6074-a9fe-4faf-acf0-7eb6e1032721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e4025a50-6151-4cb0-9b1e-0f445434f897 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Created volume successfully. Apr 01 08:06:49 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 is fetched for user aca91e3aeca1461caf3ad9e3be6e9d05. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4126c6-353b-4182-89b6-d40254827336]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:49 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD Apr 01 08:06:49 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:50 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70" returned: 0 in 0.789s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:50 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70 Apr 01 08:06:50 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "cinder-42752c0a-91af-4a67-bf88-0ac4db79e04e-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "cinder-42752c0a-91af-4a67-bf88-0ac4db79e04e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "cinder-quobyte-42752c0a-91af-4a67-bf88-0ac4db79e04e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "cinder-quobyte-42752c0a-91af-4a67-bf88-0ac4db79e04e" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82042cc-3ee2-4b5e-9042-016b3ffd8d8c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:50 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df092a8-cac3-4798-9478-65dc83b2b65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69325ee12b343f4ad9dbf36da9ae2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:48Z,use_quota=True,user_id='aca91e3aeca1461caf3ad9e3be6e9d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Creating volume 5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:50 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:50 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1073741824 Apr 01 08:06:50 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:50 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e Apr 01 08:06:50 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:50 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-848acb11-f446-4239-96c1-5e278ff4ae70" returned: 0 in 0.671s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-848acb11-f446-4239-96c1-5e278ff4ae70" released by "delete_volume" :: held 1.486s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Created reservations ['86efcf82-fcef-486e-acc6-bbbcf72a842a', '00c7962c-3b5b-4914-9936-93e9674d393c', 'a4bc3809-e34c-4839-a272-b91b69a89d4f', '80452186-8839-483b-865d-580823f9c652'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:50 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:50 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:51 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e" returned: 0 in 0.740s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:51 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e Apr 01 08:06:51 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:51 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1073741824" returned: 0 in 0.876s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:51 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:06:51 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-eb538c54-92fa-4f31-aad0-763e1752b547-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "cinder-eb538c54-92fa-4f31-aad0-763e1752b547-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-eb538c54-92fa-4f31-aad0-763e1752b547" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-eb538c54-92fa-4f31-aad0-763e1752b547" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:51 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.770s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ec1e6-55d6-4c36-bc22-fcf4a0b8472d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24cbd187-b9bb-4982-b13c-20919fa201ea tempest-VolumesGetTest-1842760555 None] Lock "cinder-848acb11-f446-4239-96c1-5e278ff4ae70-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:51 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 Apr 01 08:06:51 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:51 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-42752c0a-91af-4a67-bf88-0ac4db79e04e" returned: 0 in 0.633s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "cinder-quobyte-42752c0a-91af-4a67-bf88-0ac4db79e04e" released by "delete_volume" :: held 1.411s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Created reservations ['ea3f4125-a850-4426-899c-660cca6488eb', '789aa255-afa8-467d-a3c8-2f014c1c9451', '29c6b355-8121-48cc-ae4b-9e4d973a73e2', '450b2f96-7fab-4ee3-ac19-79bb77e80033'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:51 devstack sudo[85615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:51 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:52 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 0.905s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:52 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547" returned: 0 in 0.720s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Attempting download of 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 5df092a8-cac3-4798-9478-65dc83b2b65e. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 01 08:06:52 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547 Apr 01 08:06:52 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7853fef-7812-4514-85f1-a20da46298a8]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:52 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6 Apr 01 08:06:52 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:52 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.901s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Deleted volume successfully. Apr 01 08:06:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-253f2b39-a692-44b0-96b3-dfb77984292e tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "cinder-42752c0a-91af-4a67-bf88-0ac4db79e04e-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:53 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb538c54-92fa-4f31-aad0-763e1752b547" returned: 0 in 0.730s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-eb538c54-92fa-4f31-aad0-763e1752b547" released by "delete_volume" :: held 1.491s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Created reservations ['83327929-c610-4d13-9297-1fba8a74e4e0', 'a13b7d53-2fe4-4722-a408-ea71c618a9b0', 'ef8f2e2e-7347-449e-9915-1498f1f2bb2a', '938188c8-157d-4257-9815-782b32637686'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:53 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6" returned: 0 in 0.827s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:53 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:53 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Flow 'volume_create_manager' (53c55cd5-2598-4d67-9570-422049e0ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc2a5c0-aed7-45f8-a8e8-e02c6696b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc2a5c0-aed7-45f8-a8e8-e02c6696b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2048841361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62edfddd-83c5-4ff6-8b2b-d381598821ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc39707cd9c4bee8a16ba9de9cc183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:53Z,use_quota=True,user_id='66c675579e4545d98b566d261388fbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc6208e-b8df-4c5e-a84c-473bc222c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc6208e-b8df-4c5e-a84c-473bc222c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:53 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6 Apr 01 08:06:53 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118cca1-3f6b-4360-ac8b-4079981cf50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118cca1-3f6b-4360-ac8b-4079981cf50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62edfddd-83c5-4ff6-8b2b-d381598821ae', 'volume_name': 'volume-62edfddd-83c5-4ff6-8b2b-d381598821ae', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d137b2-546a-4dc1-b344-476b63c376ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d137b2-546a-4dc1-b344-476b63c376ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24249c10-c5d6-40b3-924e-34bdb8558be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:53 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume 62edfddd-83c5-4ff6-8b2b-d381598821ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62edfddd-83c5-4ff6-8b2b-d381598821ae', 'volume_size': 1} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2048841361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62edfddd-83c5-4ff6-8b2b-d381598821ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc39707cd9c4bee8a16ba9de9cc183c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:53Z,use_quota=True,user_id='66c675579e4545d98b566d261388fbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Creating volume 62edfddd-83c5-4ff6-8b2b-d381598821ae {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:53 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:53 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae 1073741824 Apr 01 08:06:53 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:53 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6" returned: 1 in 0.638s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_q2b8rqz6' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8799d-5e46-4cd3-8380-c76b064e01b6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:53 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.739s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:53 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-273d3fd3-8c90-42a0-956c-005c789d28e5 tempest-VolumesGetTest-1842760555 None] Lock "cinder-eb538c54-92fa-4f31-aad0-763e1752b547-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:54 devstack sudo[85667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD Apr 01 08:06:54 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:54 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae 1073741824" returned: 0 in 0.857s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:54 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae Apr 01 08:06:54 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (dca1bd9b-c26d-4702-a84f-19be20dc7ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe955c1-72ea-44b4-9c95-f2c83b6573c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe955c1-72ea-44b4-9c95-f2c83b6573c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821200368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:54Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c26096-dcd2-4c3a-aa71-e85443e3aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c26096-dcd2-4c3a-aa71-e85443e3aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ffcdc5-528c-41f8-84d1-dce755b3e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ffcdc5-528c-41f8-84d1-dce755b3e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'volume_name': 'volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a95731-467e-4a20-a984-3da6ef64d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a95731-467e-4a20-a984-3da6ef64d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab0c52c-a642-4c8f-832d-f70317bf781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Volume 5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'volume_size': 1} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:54 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] 545c3f16-13af-4c88-b00b-d5d8aaf80866 was qcow2, converting to raw {{(pid=82084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:54 devstack sudo[85678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:06:54 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:54 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae" returned: 0 in 0.502s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-821200368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:54Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Creating volume 5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:06:54 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24249c10-c5d6-40b3-924e-34bdb8558be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62edfddd-83c5-4ff6-8b2b-d381598821ae', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b644b4-aed2-4d51-97a3-7c252c48479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:54 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Volume volume-62edfddd-83c5-4ff6-8b2b-d381598821ae (62edfddd-83c5-4ff6-8b2b-d381598821ae): created successfully Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b644b4-aed2-4d51-97a3-7c252c48479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Flow 'volume_create_manager' (53c55cd5-2598-4d67-9570-422049e0ded2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:54 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a 1073741824 Apr 01 08:06:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-06beeec5-e1f8-45c5-8f30-737617a81a05 tempest-VolumeQuotasAdminTestJSON-1209924311 None] Created volume successfully. Apr 01 08:06:54 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:55 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a 1073741824" returned: 0 in 0.932s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:55 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:06:55 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:55 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:55 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:55 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 1.142s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_zxb_yaamdevstack@QuobyteHD, size 112.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:06:55 devstack cinder-volume[82084]: INFO cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Converted 112.00 MB image at 97.94 MB/s Apr 01 08:06:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:55 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1G Apr 01 08:06:55 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f4d4c60a-38a7-4c42-b8fb-5451e92bd59f tempest-VolumeQuotasAdminTestJSON-740831488 None] Transfer volume completed successfully. Apr 01 08:06:56 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.653s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab0c52c-a642-4c8f-832d-f70317bf781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93981881-0230-45ff-99dd-c7ef79e28168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Volume volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a (5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a): created successfully Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93981881-0230-45ff-99dd-c7ef79e28168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (dca1bd9b-c26d-4702-a84f-19be20dc7ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:56 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:56 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-37f49f7f-38b1-405d-be2e-d4e296d25342 tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e 1G" returned: 0 in 0.667s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e9626-a31e-497c-a17a-cbe1202acdba]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:56 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.840s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:56 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:06:56 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Acquiring lock "cinder-62edfddd-83c5-4ff6-8b2b-d381598821ae-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "cinder-62edfddd-83c5-4ff6-8b2b-d381598821ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Acquiring lock "cinder-quobyte-62edfddd-83c5-4ff6-8b2b-d381598821ae" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "cinder-quobyte-62edfddd-83c5-4ff6-8b2b-d381598821ae" acquired by "delete_volume" :: waited 0.033s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4cfb39-6564-4c71-9228-9bb4cbf801bf]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:57 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae Apr 01 08:06:57 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:57 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 0.636s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:57 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:06:57 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:57 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae" returned: 0 in 0.722s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:57 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae Apr 01 08:06:57 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:58 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 1 in 0.815s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Downloaded image 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 5df092a8-cac3-4798-9478-65dc83b2b65e successfully. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 for user aca91e3aeca1461caf3ad9e3be6e9d05 is deleted. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Marking volume 5df092a8-cac3-4798-9478-65dc83b2b65e as bootable. {{(pid=82084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Copying metadata from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 to 5df092a8-cac3-4798-9478-65dc83b2b65e. {{(pid=82084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Creating volume glance metadata for volume 5df092a8-cac3-4798-9478-65dc83b2b65e backed by image 545c3f16-13af-4c88-b00b-d5d8aaf80866 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74878d79-81b5-46e2-a48a-5712fde76bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df092a8-cac3-4798-9478-65dc83b2b65e', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9110f756-6683-4b91-91a1-2d2813253551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Volume volume-5df092a8-cac3-4798-9478-65dc83b2b65e (5df092a8-cac3-4798-9478-65dc83b2b65e): created successfully Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9110f756-6683-4b91-91a1-2d2813253551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Flow 'volume_create_manager' (e02b797b-0ab9-4417-951b-39f5c5aed3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-f0c8d4eb-a3af-4150-b974-1e5da50edff5 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Created volume successfully. Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (578ba3f3-d8f0-4d91-87f8-22a42f9eadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67287482-fdcc-46a3-acb1-c48508510be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67287482-fdcc-46a3-acb1-c48508510be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1454471003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8031365e-a250-414a-8386-80c7019df522,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:58Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78de830d-771c-44b7-b5e9-ea360573dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78de830d-771c-44b7-b5e9-ea360573dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a73e92-f5bd-4760-8f60-e9acc15e72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-62edfddd-83c5-4ff6-8b2b-d381598821ae" returned: 0 in 0.610s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a73e92-f5bd-4760-8f60-e9acc15e72bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8031365e-a250-414a-8386-80c7019df522', 'volume_name': 'volume-8031365e-a250-414a-8386-80c7019df522', 'volume_size': 1, 'source_volid': '5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54894c87-45e3-4529-9bb6-b5e0778602ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54894c87-45e3-4529-9bb6-b5e0778602ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cf0c30-d0d8-48ce-9a70-92a5f869fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Volume 8031365e-a250-414a-8386-80c7019df522: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8031365e-a250-414a-8386-80c7019df522', 'volume_size': 1, 'source_volid': '5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'source_volstatus': 'available'} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "cinder-quobyte-62edfddd-83c5-4ff6-8b2b-d381598821ae" released by "delete_volume" :: held 1.403s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.008s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:58 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Cloning volume 5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a to volume 8031365e-a250-414a-8386-80c7019df522 Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Creating offline snapshot c38cdbf5-5afb-450e-953e-d2fabbe76432 of volume 5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Created reservations ['66359278-2690-4bf4-9ec8-b618114e7d23', 'eb625216-9143-4c82-b29b-4334c6153667', '9c06cb93-468c-41d1-8ce3-792dbbc8537d', 'dfaa3a5f-630b-42f4-8962-f626433e8b24'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee8451-0ab7-4500-816d-2df9c6f56f95]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (4c8dcf80-f179-4480-8828-b3d7a367639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd032ba-898a-4a7c-9a29-15e2cffd2b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:06:58 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd032ba-898a-4a7c-9a29-15e2cffd2b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1648926956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9e38f4-6587-4357-b802-16f60b1d01fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:58Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af51c06-c270-4855-b597-8cfac4a57aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af51c06-c270-4855-b597-8cfac4a57aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9452435-5e03-4f40-8960-6c49216505ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9452435-5e03-4f40-8960-6c49216505ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9e38f4-6587-4357-b802-16f60b1d01fa', 'volume_name': 'volume-be9e38f4-6587-4357-b802-16f60b1d01fa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72ae405-45b3-4423-9b41-f25b49801d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72ae405-45b3-4423-9b41-f25b49801d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eed2aa7-4e2a-420c-99f5-874ceb91a440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:06:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Volume be9e38f4-6587-4357-b802-16f60b1d01fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9e38f4-6587-4357-b802-16f60b1d01fa', 'volume_size': 1} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:58 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:06:58 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:58 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.463s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:58 devstack sudo[85760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 1G Apr 01 08:06:58 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:06:59 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.461s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:59 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:06:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Deleted volume successfully. Apr 01 08:06:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ab29bb2e-ec25-47df-803c-6fcac0e9d44c tempest-VolumeQuotasAdminTestJSON-1908940321 None] Lock "cinder-62edfddd-83c5-4ff6-8b2b-d381598821ae-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:06:59 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root Apr 01 08:06:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 1G" returned: 0 in 0.667s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:06:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:06:59 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:06:59 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:00 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:00 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 is being set with open permissions: ugo+rw Apr 01 08:07:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:00 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:07:00 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:00 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.552s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:00 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info Apr 01 08:07:00 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:01 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info" returned: 0 in 0.472s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info is being set with open permissions: ugo+rw Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:01 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info Apr 01 08:07:01 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:01 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.info" returned: 0 in 0.479s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] snapshot: c38cdbf5-5afb-450e-953e-d2fabbe76432, volume: 8031365e-a250-414a-8386-80c7019df522, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42fb0c-7a6c-45a5-ac06-14f11f2b43e4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:01 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:07:01 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:02 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.595s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d28cd0-5fcd-4c26-9f41-3629ab9b5801]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:02 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:07:02 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:02 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.565s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:07:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:02 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 Apr 01 08:07:02 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Flow 'volume_create_manager' (a5ae4a0b-1c4f-47a4-8d53-4ed9152e51ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4cc1c6-f31f-43ab-abc6-d257818fc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4cc1c6-f31f-43ab-abc6-d257818fc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1137280213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11f57bcbbf469fa5c007b867f28169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:05Z,use_quota=True,user_id='a14951643f914a1c8686e01759da8e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7c683be-979b-458d-a77f-1a99e4a70985),volume_type_id=a7c683be-979b-458d-a77f-1a99e4a70985)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b4d360-bd80-4905-862c-8fec6bdeb56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b4d360-bd80-4905-862c-8fec6bdeb56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4aff2d-f3b4-4e3f-b09f-a03373083a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4aff2d-f3b4-4e3f-b09f-a03373083a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d', 'volume_name': 'volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d784e8c-506e-4dc9-b5e4-dec088bb525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d784e8c-506e-4dc9-b5e4-dec088bb525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d56b42-6305-4474-8c59-0f5dd134443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:04 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Volume d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d', 'volume_size': 1} Apr 01 08:07:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:05 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522" returned: 0 in 2.383s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82d347-e784-453a-a3e9-e1205975522b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:05 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:07:05 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:05 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.548s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:07:05 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Converted 1024.00 MB image at 429.56 MB/s Apr 01 08:07:05 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 is being set with open permissions: ugo+rw Apr 01 08:07:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:05 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 Apr 01 08:07:05 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:06 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522" returned: 0 in 0.380s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" released by "_copy_volume_from_snapshot" :: held 4.522s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-c38cdbf5-5afb-450e-953e-d2fabbe76432" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-c38cdbf5-5afb-450e-953e-d2fabbe76432" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Deleting offline snapshot c38cdbf5-5afb-450e-953e-d2fabbe76432 of volume 5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] snapshot_file for this snap is: volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a1412-6a6c-4c45-9827-2cc10d8137da]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:06 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:07:06 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:06 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e9a5a-1024-4582-b926-e600bb0f8448]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:06 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:07:06 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:07 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:07 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:07:07 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:07 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.398s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:07 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432 Apr 01 08:07:07 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:07 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a.c38cdbf5-5afb-450e-953e-d2fabbe76432" returned: 0 in 0.382s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-c38cdbf5-5afb-450e-953e-d2fabbe76432" released by "_delete_snapshot" :: held 1.702s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.502s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.344s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1648926956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9e38f4-6587-4357-b802-16f60b1d01fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:06:58Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Creating volume be9e38f4-6587-4357-b802-16f60b1d01fa {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:07 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cf0c30-d0d8-48ce-9a70-92a5f869fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8031365e-a250-414a-8386-80c7019df522', 'volume_size': 1, 'source_volid': '5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:07 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa 1073741824 Apr 01 08:07:07 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0997fa3-b423-4ebc-82e9-658cac6c1db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:07 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Volume volume-8031365e-a250-414a-8386-80c7019df522 (8031365e-a250-414a-8386-80c7019df522): created successfully Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0997fa3-b423-4ebc-82e9-658cac6c1db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (578ba3f3-d8f0-4d91-87f8-22a42f9eadf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7e4e04c0-e910-4ad3-824d-dc516e12d72f tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:07:08 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa 1073741824" returned: 0 in 0.481s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:08 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa Apr 01 08:07:08 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:08 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa" returned: 0 in 0.388s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.260s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eed2aa7-4e2a-420c-99f5-874ceb91a440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9e38f4-6587-4357-b802-16f60b1d01fa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc99d16-7f99-4ff0-b0af-d4ba0fccf13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:08 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Volume volume-be9e38f4-6587-4357-b802-16f60b1d01fa (be9e38f4-6587-4357-b802-16f60b1d01fa): created successfully Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc99d16-7f99-4ff0-b0af-d4ba0fccf13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (4c8dcf80-f179-4480-8828-b3d7a367639d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c8d841-8756-45ec-934b-d5f178ceb3ba]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-76cbdd75-2976-44f7-9e52-790e3c97ae90 tempest-VolumesListAdminTestJSON-564088209 None] Created volume successfully. Apr 01 08:07:08 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:07:08 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (b4653446-cdcb-4f66-b175-9a980d39f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573dd7f6-fb78-4138-a623-0fb92b243cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:09 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 0.507s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573dd7f6-fb78-4138-a623-0fb92b243cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-307456388',display_name='tempest-VolumesGetTest-Volume-1408007360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad2f6c3-d53e-492d-a184-4507377ffc75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:09Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8e4bb-14ff-48d9-9a04-6d5ae0aa12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8e4bb-14ff-48d9-9a04-6d5ae0aa12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09cb62-ccf4-4b7d-9daf-244be7ece2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d09cb62-ccf4-4b7d-9daf-244be7ece2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ad2f6c3-d53e-492d-a184-4507377ffc75', 'volume_name': 'volume-6ad2f6c3-d53e-492d-a184-4507377ffc75', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe64405-c208-4c2f-bcee-f4b3583d45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe64405-c208-4c2f-bcee-f4b3583d45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9978da-df86-404f-b59a-43dda06e6314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:09 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Volume 6ad2f6c3-d53e-492d-a184-4507377ffc75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ad2f6c3-d53e-492d-a184-4507377ffc75', 'volume_size': 1} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:09 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:07:09 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:09 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 1 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.846s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1137280213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11f57bcbbf469fa5c007b867f28169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:05Z,use_quota=True,user_id='a14951643f914a1c8686e01759da8e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7c683be-979b-458d-a77f-1a99e4a70985),volume_type_id=a7c683be-979b-458d-a77f-1a99e4a70985)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Creating volume d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:09 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:09 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d 1073741824 Apr 01 08:07:09 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5', 'name': 'volume-5df092a8-cac3-4798-9478-65dc83b2b65e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4556c33-eca7-4765-9e59-308b497eef9d', 'enforce_multipath': True} {{(pid=82084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 01 08:07:09 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-6332ad47-d87f-4d80-8b7b-e301d8e0b932 req-00ea63bc-0e2a-41df-a697-db3e75a97e72 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] attachment_update completed successfully. Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (5286f440-49bb-4ff5-8f92-bc2d96ef52e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb8a1d-b0f5-4583-b98d-1dd3d96712e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb8a1d-b0f5-4583-b98d-1dd3d96712e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1747870149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1d1bf-b281-4865-bd3d-8de0e0392cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:10Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff801678-6042-48d4-9538-60bb8f2fdd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff801678-6042-48d4-9538-60bb8f2fdd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293bd75e-c29e-4ce6-b861-989ef431ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293bd75e-c29e-4ce6-b861-989ef431ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f1d1bf-b281-4865-bd3d-8de0e0392cbf', 'volume_name': 'volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42544992-c3fb-4699-97c2-8d50ac1cc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42544992-c3fb-4699-97c2-8d50ac1cc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d981b3a-3d02-4c6f-842d-4cfbf5cdef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Volume 70f1d1bf-b281-4865-bd3d-8de0e0392cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf', 'volume_size': 1} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:10 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d 1073741824" returned: 0 in 0.542s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:10 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d Apr 01 08:07:10 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:10 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" returned: 0 in 0.410s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.384s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-307456388',display_name='tempest-VolumesGetTest-Volume-1408007360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad2f6c3-d53e-492d-a184-4507377ffc75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:09Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Creating volume 6ad2f6c3-d53e-492d-a184-4507377ffc75 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:10 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d56b42-6305-4474-8c59-0f5dd134443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d1715-1349-457e-b8c2-b4097e50573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:10 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 1073741824 Apr 01 08:07:10 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:10 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Volume volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d (d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d): created successfully Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d1715-1349-457e-b8c2-b4097e50573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Flow 'volume_create_manager' (a5ae4a0b-1c4f-47a4-8d53-4ed9152e51ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b3c25b18-0e98-4ecd-ad24-87134e34ae32 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Created volume successfully. Apr 01 08:07:11 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 1073741824" returned: 0 in 0.561s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:11 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 Apr 01 08:07:11 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:11 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:11 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:11 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75" returned: 0 in 0.418s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1747870149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1d1bf-b281-4865-bd3d-8de0e0392cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:10Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Creating volume 70f1d1bf-b281-4865-bd3d-8de0e0392cbf {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:11 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9978da-df86-404f-b59a-43dda06e6314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad2f6c3-d53e-492d-a184-4507377ffc75', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:11 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf 1073741824 Apr 01 08:07:11 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a93ea-74a9-484c-bad8-cb7949d489cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:11 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Volume volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 (6ad2f6c3-d53e-492d-a184-4507377ffc75): created successfully Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a93ea-74a9-484c-bad8-cb7949d489cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (b4653446-cdcb-4f66-b175-9a980d39f46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-5a2cc918-8bee-4354-bad8-6d8bb9ee57cb tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:07:12 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.472s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:12 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f740e22e-629d-4172-a17d-337a5498b8c5 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Retype volume completed successfully. Apr 01 08:07:12 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf 1073741824" returned: 0 in 0.484s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:12 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf Apr 01 08:07:12 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-6ad2f6c3-d53e-492d-a184-4507377ffc75-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "cinder-6ad2f6c3-d53e-492d-a184-4507377ffc75-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-6ad2f6c3-d53e-492d-a184-4507377ffc75" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-6ad2f6c3-d53e-492d-a184-4507377ffc75" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ca94b-e51c-4f2a-aa2b-d3295c584907]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:12 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 Apr 01 08:07:12 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "cinder-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "cinder-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "cinder-quobyte-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:12 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" returned: 0 in 0.450s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "cinder-quobyte-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d981b3a-3d02-4c6f-842d-4cfbf5cdef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693cd594-5c1c-4273-a4be-5c06ce892b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9bb1e4-f050-45e5-9eb5-4ae33b6a8142]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:12 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Volume volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf (70f1d1bf-b281-4865-bd3d-8de0e0392cbf): created successfully Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693cd594-5c1c-4273-a4be-5c06ce892b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (5286f440-49bb-4ff5-8f92-bc2d96ef52e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:12 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d0de90f3-7145-44d9-bec2-a0617bda0710 tempest-VolumesListAdminTestJSON-564088209 None] Created volume successfully. Apr 01 08:07:12 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d Apr 01 08:07:12 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:13 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75" returned: 0 in 0.489s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:13 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75 Apr 01 08:07:13 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:13 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" returned: 0 in 0.479s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:13 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d Apr 01 08:07:13 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:13 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ad2f6c3-d53e-492d-a184-4507377ffc75" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-6ad2f6c3-d53e-492d-a184-4507377ffc75" released by "delete_volume" :: held 0.944s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (9a286b4a-83db-45e9-99c8-d2e520878c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aaca24-484c-43cb-ba60-30e6ad7baeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aaca24-484c-43cb-ba60-30e6ad7baeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1190554683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f6aea-a748-45d6-8f3d-630057e9d33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:14Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6952cb77-fafd-44c6-8dd6-db73f12a601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6952cb77-fafd-44c6-8dd6-db73f12a601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159a890-291a-4632-902a-46adeb7dba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159a890-291a-4632-902a-46adeb7dba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8f6aea-a748-45d6-8f3d-630057e9d33d', 'volume_name': 'volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eba5a6-70ef-4462-b3ad-279e54056eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eba5a6-70ef-4462-b3ad-279e54056eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f649aeec-92ec-4ad3-bb06-9e49d3bf5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Volume 3e8f6aea-a748-45d6-8f3d-630057e9d33d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d', 'volume_size': 1} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1190554683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f6aea-a748-45d6-8f3d-630057e9d33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb293678e2d24da2bb1df823f847f05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:14Z,use_quota=True,user_id='451416bc992c42c192eac64068668aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Creating volume 3e8f6aea-a748-45d6-8f3d-630057e9d33d {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:13 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:13 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d 1073741824 Apr 01 08:07:13 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Created reservations ['305e4095-920d-422a-88f3-170f5bf0801d', 'aac47db1-a556-46c8-b23b-01762e43f47f', '65a78a37-78b9-4315-90b7-e6bbe73f7b0b', '6fc75974-83fe-4579-b509-5fa41c448076'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:13 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" returned: 0 in 0.451s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "cinder-quobyte-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d" released by "delete_volume" :: held 0.983s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:13 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:13 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:13 devstack cinder-volume[82084]: WARNING cinder.quota [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:07:13 devstack cinder-volume[82084]: WARNING cinder.quota [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Created reservations ['3b0dec83-f88a-4018-84a3-a46a851fd1d3', '15f63cb3-0bc2-4a23-8a07-9a95d75330da', '1d6aa701-10fe-405a-93d7-93a207e8c83d', '25d617de-a1fd-48b9-8df4-8c4bae4f4e52'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:13 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:13 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:14 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:07:14 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d 1073741824" returned: 0 in 0.676s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e2cd596-abad-402a-abc1-1c3261eff675 tempest-VolumesGetTest-1842760555 None] Lock "cinder-6ad2f6c3-d53e-492d-a184-4507377ffc75-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:14 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d Apr 01 08:07:14 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:14 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.640s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Deleted volume successfully. Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-39c47ffb-251c-4e53-b8e3-98a123713801 tempest-VolumeRetypeWithoutMigrationTest-187131752 None] Lock "cinder-d780d6fe-f2b9-435b-a5c2-d5e9ed9f9a0d-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-8031365e-a250-414a-8386-80c7019df522-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "cinder-8031365e-a250-414a-8386-80c7019df522-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b00b4-7777-4d92-8b11-7aeb86964bdb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:15 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d" returned: 0 in 0.763s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f649aeec-92ec-4ad3-bb06-9e49d3bf5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7070d75-03ff-42da-a298-6b11a5101c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:15 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 Apr 01 08:07:15 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Volume volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d (3e8f6aea-a748-45d6-8f3d-630057e9d33d): created successfully Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7070d75-03ff-42da-a298-6b11a5101c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Flow 'volume_create_manager' (9a286b4a-83db-45e9-99c8-d2e520878c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-65c56e72-0873-4ad7-aecd-6fbefd9a1f50 tempest-VolumesListAdminTestJSON-564088209 None] Created volume successfully. Apr 01 08:07:15 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522" returned: 0 in 0.760s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:15 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522 Apr 01 08:07:15 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:16 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Flow 'volume_create_manager' (80e1d4f1-4a16-4235-82fa-5d19fe6050b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778e546-c303-4d8f-a135-c768ae3af338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-8031365e-a250-414a-8386-80c7019df522" returned: 0 in 0.558s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778e546-c303-4d8f-a135-c768ae3af338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26eb5b5-aa7a-493f-82d8-9852c0023148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606df731161b473e873c27726a4732f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:16Z,use_quota=True,user_id='5a3663addf1f4dd8b11aa9cf0d0d17d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ab7371-c4fc-4c7b-9096-8f271c88c44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ab7371-c4fc-4c7b-9096-8f271c88c44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28fb09c-bfec-4a8b-bad7-0c6a7b47a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28fb09c-bfec-4a8b-bad7-0c6a7b47a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26eb5b5-aa7a-493f-82d8-9852c0023148', 'volume_name': 'volume-b26eb5b5-aa7a-493f-82d8-9852c0023148', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d775a173-d552-413c-9935-fff191b3d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d775a173-d552-413c-9935-fff191b3d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba877b0-fb9b-4656-999f-2bfb00d69b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:16 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Volume b26eb5b5-aa7a-493f-82d8-9852c0023148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26eb5b5-aa7a-493f-82d8-9852c0023148', 'volume_size': 1} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26eb5b5-aa7a-493f-82d8-9852c0023148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606df731161b473e873c27726a4732f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:16Z,use_quota=True,user_id='5a3663addf1f4dd8b11aa9cf0d0d17d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Creating volume b26eb5b5-aa7a-493f-82d8-9852c0023148 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:16 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-8031365e-a250-414a-8386-80c7019df522" released by "delete_volume" :: held 1.439s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:16 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 1073741824 Apr 01 08:07:16 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Created reservations ['c96c9a8a-f4b6-48f5-a017-1fb1251f8293', 'c12dab6b-758e-48ae-ad87-225c88d0a601', 'fbd1bfbe-7b2d-41b5-be96-4a247f8d0850', 'ba83adc2-e5ca-4201-87ef-cd98fd2b3f69'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:16 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:16 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:17 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.541s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:17 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-239b8147-ee1b-4669-91c5-83b574d5c1c2 tempest-VolumesGetTest-1842760555 None] Lock "cinder-8031365e-a250-414a-8386-80c7019df522-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "cinder-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" acquired by "delete_volume" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3068f98e-2efa-460d-91b6-70bb8128c50e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:17 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:07:17 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:17 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 1073741824" returned: 0 in 1.045s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:17 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 Apr 01 08:07:17 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:18 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.685s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:18 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a Apr 01 08:07:18 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:18 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148" returned: 0 in 0.878s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba877b0-fb9b-4656-999f-2bfb00d69b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26eb5b5-aa7a-493f-82d8-9852c0023148', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ab77a3-c521-4674-966f-f79ed9a9b41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:18 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Volume volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 (b26eb5b5-aa7a-493f-82d8-9852c0023148): created successfully Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ab77a3-c521-4674-966f-f79ed9a9b41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Flow 'volume_create_manager' (80e1d4f1-4a16-4235-82fa-5d19fe6050b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7e187805-c192-4886-b60d-ed10b89773b3 tempest-VolumesListAdminTestJSON-891863200 None] Created volume successfully. Apr 01 08:07:18 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" returned: 0 in 0.580s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a" released by "delete_volume" :: held 1.320s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Acquiring lock "cinder-b26eb5b5-aa7a-493f-82d8-9852c0023148-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Created reservations ['178081df-13b1-4e18-814f-71774ae23307', '3862b21e-68e1-4e22-9e09-272d3cb6543d', '3637728a-4021-4690-8794-9e619ec2acd3', 'cd065f3f-333c-4480-ae82-86b7a0422460'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "cinder-b26eb5b5-aa7a-493f-82d8-9852c0023148-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-3e8f6aea-a748-45d6-8f3d-630057e9d33d-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:18 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:18 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Acquiring lock "cinder-quobyte-b26eb5b5-aa7a-493f-82d8-9852c0023148" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "cinder-quobyte-b26eb5b5-aa7a-493f-82d8-9852c0023148" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-3e8f6aea-a748-45d6-8f3d-630057e9d33d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac58d8f-2a1e-46a1-b635-064c9146ee0a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-quobyte-3e8f6aea-a748-45d6-8f3d-630057e9d33d" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Flow 'volume_create_manager' (2e5360ea-cfe5-4e19-9056-5b14d51f17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf4a13a-ed7a-4457-8bd3-70d4ceb087e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf4a13a-ed7a-4457-8bd3-70d4ceb087e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2097025289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd57b65daaf74c468ede355682ac9502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:19Z,use_quota=True,user_id='ea7194d43a5643e5b92c0f0bd0b2deac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143d489c-ee6d-412e-b10a-731dadbb0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143d489c-ee6d-412e-b10a-731dadbb0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72703002-b7c3-461c-b3a5-91b17445822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72703002-b7c3-461c-b3a5-91b17445822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0', 'volume_name': 'volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd561576-d42d-4d98-bc7e-9f3e131eec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:19 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 Apr 01 08:07:19 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd561576-d42d-4d98-bc7e-9f3e131eec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee03a882-d8ea-4870-9714-04e963ad5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Volume d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0', 'volume_size': 1} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2097025289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd57b65daaf74c468ede355682ac9502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:19Z,use_quota=True,user_id='ea7194d43a5643e5b92c0f0bd0b2deac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Creating volume d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:19 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-3e8f6aea-a748-45d6-8f3d-630057e9d33d" acquired by "delete_volume" :: waited 0.170s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:19 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 1073741824 Apr 01 08:07:19 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7652de9a-9c32-42f1-9a1d-5a1f84544a1d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:19 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.605s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:07:19 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d Apr 01 08:07:19 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6eed9dfb-70e5-4132-b952-e0a863fea355 tempest-VolumesGetTest-1842760555 None] Lock "cinder-5d32ac1d-abc0-45a5-9996-0ef7ba7aa23a-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:19 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148" returned: 0 in 0.754s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:19 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148 Apr 01 08:07:19 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:20 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d" returned: 0 in 0.910s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:20 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d Apr 01 08:07:20 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:20 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 1073741824" returned: 0 in 1.141s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (84c0d638-af3f-43b9-b1d8-241e4b409566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bebfdb-80c1-4417-8dee-50a7aea3bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:20 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 Apr 01 08:07:20 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bebfdb-80c1-4417-8dee-50a7aea3bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1943490873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18294aa7-147b-430f-b394-a47537487452,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:20Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9559207-3408-4191-9d8f-5ac0ab99a439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9559207-3408-4191-9d8f-5ac0ab99a439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6878ccb3-70cd-41e1-8cf4-27477e1aef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.image.glance [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Creating Keystone auth plugin from conf {{(pid=82084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 01 08:07:20 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b26eb5b5-aa7a-493f-82d8-9852c0023148" returned: 0 in 0.858s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6878ccb3-70cd-41e1-8cf4-27477e1aef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18294aa7-147b-430f-b394-a47537487452', 'volume_name': 'volume-18294aa7-147b-430f-b394-a47537487452', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89183894-5024-471f-8b38-d8942bbb9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89183894-5024-471f-8b38-d8942bbb9020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfbaa68-1ab6-45fc-9b2a-2cd1809ef269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Volume 18294aa7-147b-430f-b394-a47537487452: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18294aa7-147b-430f-b394-a47537487452', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Trying to clone 18294aa7-147b-430f-b394-a47537487452 from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 at location (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]). {{(pid=82084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "cinder-quobyte-b26eb5b5-aa7a-493f-82d8-9852c0023148" released by "delete_volume" :: held 1.709s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Created reservations ['081ed312-684b-4279-b766-8f152907f668', 'e7852ee9-5dbf-4c40-85b9-f5e3da72b2d2', 'b3e6472a-16c3-4acd-9d8a-e248ddcc0468', '1af5fe3a-2868-4831-b471-54e0da143c51'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=144,cinder:UPDATE=174,cinder:INSERT=45,cinder:DELETE=14 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:07:20 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" returned: 0 in 0.470s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:20 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:20 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:20 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee03a882-d8ea-4870-9714-04e963ad5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6342f31-3557-416f-b062-d3e2f5104e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e8f6aea-a748-45d6-8f3d-630057e9d33d" returned: 0 in 0.720s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Volume volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 (d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0): created successfully Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6342f31-3557-416f-b062-d3e2f5104e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Flow 'volume_create_manager' (2e5360ea-cfe5-4e19-9056-5b14d51f17fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-3e8f6aea-a748-45d6-8f3d-630057e9d33d" released by "delete_volume" :: held 1.717s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-cf30ae29-2f98-4a8b-8c4b-486e33c8c011 tempest-VolumesServicesTestJSON-185213897 None] Created volume successfully. Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Created reservations ['a4d04378-f312-464f-87fb-8298e4d67b2a', 'ebd469da-c9a8-439d-bb88-8be014b7cc51', '6879c7b4-7800-4f09-9927-3908498248d8', '800d2a4f-9fa3-4a31-9726-24834e141d56'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 01 08:07:21 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Image download 20.69 MB at 20.69 MB/s Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bbae23-11fe-49d3-bd1a-b846c05becb4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:21 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:21 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:21 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD Apr 01 08:07:21 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Acquiring lock "cinder-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "cinder-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Acquiring lock "cinder-quobyte-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "cinder-quobyte-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9cbb75-a256-4cfc-916f-f0c8ee0b0076]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:21 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 Apr 01 08:07:21 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:21 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.826s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:21 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Deleted volume successfully. Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-41f0f0ce-7515-4f25-924a-da63d04f7496 tempest-VolumesListAdminTestJSON-891863200 None] Lock "cinder-b26eb5b5-aa7a-493f-82d8-9852c0023148-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:21 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 is fetched for user c7374eaff53f4d9893c1976a8a354463. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 01 08:07:21 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.617s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1f50b-4952-4bb9-b6b7-c169b5881d72]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:21 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Deleted volume successfully. Apr 01 08:07:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-102cb2ec-7c8a-41ad-a676-02ac090c0523 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-3e8f6aea-a748-45d6-8f3d-630057e9d33d-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:21 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD Apr 01 08:07:21 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-70f1d1bf-b281-4865-bd3d-8de0e0392cbf-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-70f1d1bf-b281-4865-bd3d-8de0e0392cbf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=170,cinder:INSERT=53,cinder:UPDATE=203,cinder:DELETE=16 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:07:22 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" returned: 0 in 0.814s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-quobyte-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0 Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" acquired by "delete_volume" :: waited 0.044s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:22 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872fc85-2d70-4d51-b7fb-beb8ea09fb00]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf Apr 01 08:07:22 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1943490873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18294aa7-147b-430f-b394-a47537487452,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:20Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Creating volume 18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:22 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1073741824 Apr 01 08:07:22 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" returned: 0 in 0.498s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "cinder-quobyte-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0" released by "delete_volume" :: held 1.348s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Created reservations ['ef57c8ca-0345-4e5d-bdbd-66261003a1dd', 'a1d2dcc6-6c9f-4c57-8d85-9c9b77fdce1d', '2417553a-db7c-48ab-a72f-09177b3c0c65', '348852f6-4279-4a2d-ae88-4ccc87c309b7'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:22 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" returned: 0 in 0.513s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf Apr 01 08:07:22 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:22 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:22 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1073741824" returned: 0 in 0.510s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:22 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:22 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:23 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Deleted volume successfully. Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-304049c2-35c7-4b2d-93b6-b216daf4908b tempest-VolumesServicesTestJSON-185213897 None] Lock "cinder-d2b4779c-ece0-4b40-8e9a-c93e7c7e8ca0-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:23 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" returned: 0 in 0.481s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-70f1d1bf-b281-4865-bd3d-8de0e0392cbf" released by "delete_volume" :: held 1.023s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Created reservations ['bb1fe0e1-ad96-4ff8-99bb-5b93c5563a55', 'aa0f7924-bc02-402c-a4c2-24876881b8fc', '4f9349d1-cd42-43a5-965b-6e13157f5aeb', 'e979040a-478e-49cf-b077-ee273d783152'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:23 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:23 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:23 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Attempting download of 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 18294aa7-147b-430f-b394-a47537487452. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdaf332-6013-40d9-a934-bc9abbc95bc5]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:23 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac Apr 01 08:07:23 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:23 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Deleted volume successfully. Apr 01 08:07:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46d439cb-7e0e-4730-b85b-e1dc201cf802 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-70f1d1bf-b281-4865-bd3d-8de0e0392cbf-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:24 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac" returned: 0 in 0.591s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:24 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac Apr 01 08:07:24 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-be9e38f4-6587-4357-b802-16f60b1d01fa-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-be9e38f4-6587-4357-b802-16f60b1d01fa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "cinder-quobyte-be9e38f4-6587-4357-b802-16f60b1d01fa" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-be9e38f4-6587-4357-b802-16f60b1d01fa" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5942ff3e-95b4-4d48-b4b8-dbd05fe15ddb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:24 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac" returned: 1 in 0.521s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_x4qk8mac' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc92673-306f-4a31-a19d-d6763712f43e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:24 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa Apr 01 08:07:24 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:24 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD Apr 01 08:07:24 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:25 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] 545c3f16-13af-4c88-b00b-d5d8aaf80866 was qcow2, converting to raw {{(pid=82084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:25 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:25 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:25 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa" returned: 0 in 0.568s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:25 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa Apr 01 08:07:25 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:25 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be9e38f4-6587-4357-b802-16f60b1d01fa" returned: 0 in 0.508s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-quobyte-be9e38f4-6587-4357-b802-16f60b1d01fa" released by "delete_volume" :: held 1.106s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Created reservations ['52ff199a-c77e-44db-b199-d19c70664379', '48011392-4286-4e7e-8214-92e26da26bd1', 'b2434981-d054-425a-98e4-8b20b94251d4', 'a763ebd8-1b33-43f6-b2e6-ec065d1b6b91'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:25 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:25 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:26 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 0 in 0.996s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_n3ccg49bdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:07:26 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Converted 112.00 MB image at 112.00 MB/s Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:26 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1G Apr 01 08:07:26 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:26 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.495s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Deleted volume successfully. Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9c2a76b0-ec41-49d3-8aec-03b3c6001be3 tempest-VolumesListAdminTestJSON-564088209 None] Lock "cinder-be9e38f4-6587-4357-b802-16f60b1d01fa-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:26 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 1G" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f65307-c50b-468c-9787-b913332c7fde]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:26 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:26 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:27 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 0 in 0.547s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:27 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:27 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:27 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 1 in 0.519s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Downloaded image 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 18294aa7-147b-430f-b394-a47537487452 successfully. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 for user c7374eaff53f4d9893c1976a8a354463 is deleted. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Marking volume 18294aa7-147b-430f-b394-a47537487452 as bootable. {{(pid=82084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Copying metadata from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 to 18294aa7-147b-430f-b394-a47537487452. {{(pid=82084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Creating volume glance metadata for volume 18294aa7-147b-430f-b394-a47537487452 backed by image 545c3f16-13af-4c88-b00b-d5d8aaf80866 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfbaa68-1ab6-45fc-9b2a-2cd1809ef269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18294aa7-147b-430f-b394-a47537487452', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a163ab0-8c63-45ce-911e-a24e7dc6c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:27 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Volume volume-18294aa7-147b-430f-b394-a47537487452 (18294aa7-147b-430f-b394-a47537487452): created successfully Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a163ab0-8c63-45ce-911e-a24e7dc6c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (84c0d638-af3f-43b9-b1d8-241e4b409566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:27 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-83c91187-6596-4e36-afcb-675b1ed21dfa tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (324e1f05-c2c8-47b4-99ec-62cbfb526b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ddedb-9f92-4985-b338-5772629bacdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207ddedb-9f92-4985-b338-5772629bacdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879691803',display_name='tempest-VolumesGetTest-Volume-445827355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc63d25a-f0c6-4f54-85d5-cb273515eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:29Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b7006e-0eae-4217-9fc9-3f741f8c9c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b7006e-0eae-4217-9fc9-3f741f8c9c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0f853f-1d74-45cf-9f3c-2d67938d6152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0f853f-1d74-45cf-9f3c-2d67938d6152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc63d25a-f0c6-4f54-85d5-cb273515eceb', 'volume_name': 'volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452b9b06-b706-45be-bca3-5c4e3ec279dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452b9b06-b706-45be-bca3-5c4e3ec279dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a46b7-b476-4c75-a997-e8a37798b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:28 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Volume dc63d25a-f0c6-4f54-85d5-cb273515eceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb', 'volume_size': 1} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1879691803',display_name='tempest-VolumesGetTest-Volume-445827355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc63d25a-f0c6-4f54-85d5-cb273515eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaab803da74a9bb0772c08c63bbea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:29Z,use_quota=True,user_id='c7374eaff53f4d9893c1976a8a354463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Creating volume dc63d25a-f0c6-4f54-85d5-cb273515eceb {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:28 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:28 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb 1073741824 Apr 01 08:07:28 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:29 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb 1073741824" returned: 0 in 0.974s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:29 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb Apr 01 08:07:29 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:30 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a46b7-b476-4c75-a997-e8a37798b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988a00ea-f957-4764-a799-e41f4c5c18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Volume volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb (dc63d25a-f0c6-4f54-85d5-cb273515eceb): created successfully Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988a00ea-f957-4764-a799-e41f4c5c18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Flow 'volume_create_manager' (324e1f05-c2c8-47b4-99ec-62cbfb526b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c67c67a3-6de9-449e-9513-10b090fe9dee tempest-VolumesGetTest-1842760555 None] Created volume successfully. Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-dc63d25a-f0c6-4f54-85d5-cb273515eceb-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "cinder-dc63d25a-f0c6-4f54-85d5-cb273515eceb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-dc63d25a-f0c6-4f54-85d5-cb273515eceb" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-dc63d25a-f0c6-4f54-85d5-cb273515eceb" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ac214c-8dfb-4b82-b73a-cdd5920db57a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:31 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb Apr 01 08:07:31 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Flow 'volume_create_manager' (516487c4-8b4b-47ff-8bc1-bd2d6ca5145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23364aab-7749-4976-897b-4d4642114c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23364aab-7749-4976-897b-4d4642114c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2064537571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549101ae-791a-4329-b7f5-5d064472b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a81dc7e1dcc40dfa0cef9a2744ead94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:31Z,use_quota=True,user_id='6b724d8b7bb84fd4b56d525a3b521130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f4088-3e85-4c5f-9b42-09937a887bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f4088-3e85-4c5f-9b42-09937a887bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef7786-379f-4332-8c78-aef55e7d8e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef7786-379f-4332-8c78-aef55e7d8e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549101ae-791a-4329-b7f5-5d064472b4e3', 'volume_name': 'volume-549101ae-791a-4329-b7f5-5d064472b4e3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d689ffc2-e7fc-42db-a6ab-d6dc22d920e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d689ffc2-e7fc-42db-a6ab-d6dc22d920e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964ca9c-1d79-49ee-aeeb-066ffef4aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:31 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Volume 549101ae-791a-4329-b7f5-5d064472b4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549101ae-791a-4329-b7f5-5d064472b4e3', 'volume_size': 1} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2064537571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549101ae-791a-4329-b7f5-5d064472b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a81dc7e1dcc40dfa0cef9a2744ead94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:31Z,use_quota=True,user_id='6b724d8b7bb84fd4b56d525a3b521130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Creating volume 549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:31 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:31 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 1073741824 Apr 01 08:07:31 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:31 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb" returned: 0 in 0.592s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:31 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb Apr 01 08:07:31 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:32 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dc63d25a-f0c6-4f54-85d5-cb273515eceb" returned: 0 in 0.492s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-dc63d25a-f0c6-4f54-85d5-cb273515eceb" released by "delete_volume" :: held 1.122s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Created reservations ['b41bd0ae-05be-4b77-8d38-e3fac11a6ac1', '35b98ec3-5787-4eca-9985-c2c94b6d631b', 'f429b8de-4f80-4f85-9e9a-307820a96eef', 'e100f527-e39b-47e9-84ad-f0726c23c581'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:32 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:32 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:32 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 1073741824" returned: 0 in 0.682s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:32 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 Apr 01 08:07:32 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:32 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3" returned: 0 in 0.552s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:32 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964ca9c-1d79-49ee-aeeb-066ffef4aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549101ae-791a-4329-b7f5-5d064472b4e3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6392e91-4bdb-41ab-93b9-ed0226ce2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.655s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:07:32 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Volume volume-549101ae-791a-4329-b7f5-5d064472b4e3 (549101ae-791a-4329-b7f5-5d064472b4e3): created successfully Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6392e91-4bdb-41ab-93b9-ed0226ce2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Flow 'volume_create_manager' (516487c4-8b4b-47ff-8bc1-bd2d6ca5145a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4a383706-6d8f-4794-a5e6-ad927abfa96a tempest-VolumesGetTest-1842760555 None] Lock "cinder-dc63d25a-f0c6-4f54-85d5-cb273515eceb-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-27af9060-a604-472b-8fe8-42b0f6c84b35 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Created volume successfully. Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Flow 'volume_create_manager' (263f10bf-1066-41ae-9808-009703997688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2041f67-0610-42e2-8226-31991dcbc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2041f67-0610-42e2-8226-31991dcbc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1512030654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3dff8b-7cb2-4077-a5ef-24962e562258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7638f1fc0024bdfb6fb6c592c57e634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:33Z,use_quota=True,user_id='7ae743aab8404919abb3d728cd6324c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1599591e-8ee7-40db-afe8-d11f4ccc3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1599591e-8ee7-40db-afe8-d11f4ccc3740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd3841d-5d63-461d-9144-7f66d69cb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd3841d-5d63-461d-9144-7f66d69cb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3dff8b-7cb2-4077-a5ef-24962e562258', 'volume_name': 'volume-fd3dff8b-7cb2-4077-a5ef-24962e562258', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecbc770-f4a0-40b9-a9b5-c845928b1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecbc770-f4a0-40b9-a9b5-c845928b1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4c65e1-2795-4b76-88f2-201f06f73aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:33 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Volume fd3dff8b-7cb2-4077-a5ef-24962e562258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3dff8b-7cb2-4077-a5ef-24962e562258', 'volume_size': 1} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1512030654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3dff8b-7cb2-4077-a5ef-24962e562258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7638f1fc0024bdfb6fb6c592c57e634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:33Z,use_quota=True,user_id='7ae743aab8404919abb3d728cd6324c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Creating volume fd3dff8b-7cb2-4077-a5ef-24962e562258 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:33 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:33 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 1073741824 Apr 01 08:07:33 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-18294aa7-147b-430f-b394-a47537487452-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "cinder-18294aa7-147b-430f-b394-a47537487452-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Acquiring lock "cinder-quobyte-18294aa7-147b-430f-b394-a47537487452" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-18294aa7-147b-430f-b394-a47537487452" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d996b693-359b-4016-b3b3-23c2017de0cb]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:33 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:33 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:34 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 1073741824" returned: 0 in 0.901s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:34 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 0 in 0.771s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:34 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 Apr 01 08:07:34 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:34 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:34 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:34 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258" returned: 0 in 0.414s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Creating offline snapshot ed5c286d-2fe3-4b9a-8c69-95807645ed08 of volume 549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4c65e1-2795-4b76-88f2-201f06f73aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3dff8b-7cb2-4077-a5ef-24962e562258', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd3f3e-6b63-43b8-b8f4-e161c89d70dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61589a-7425-42c6-b231-f3b61d4bbcef]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:34 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Volume volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 (fd3dff8b-7cb2-4077-a5ef-24962e562258): created successfully Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd3f3e-6b63-43b8-b8f4-e161c89d70dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Flow 'volume_create_manager' (263f10bf-1066-41ae-9808-009703997688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d89f64c2-814f-42b3-a0d8-5e40a06abdee tempest-VolumesMetadataTest-378393749 None] Created volume successfully. Apr 01 08:07:34 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 Apr 01 08:07:34 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:34 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 1 in 0.729s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:34 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452 Apr 01 08:07:34 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:35 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3" returned: 0 in 0.671s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:35 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 1G Apr 01 08:07:35 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:35 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18294aa7-147b-430f-b394-a47537487452" returned: 0 in 0.783s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "cinder-quobyte-18294aa7-147b-430f-b394-a47537487452" released by "delete_volume" :: held 2.346s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Created reservations ['1b19d497-36b5-4d80-8f9d-d868ca4b168f', 'ea4f0aad-ac3e-438c-bc66-46d54bab76a5', '24b21dc7-b654-45c0-a861-51c6f0b16e51', '183ce792-4163-411b-9346-b28677148af8'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:35 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:35 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:36 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 1G" returned: 0 in 0.924s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549101ae-791a-4329-b7f5-5d064472b4e3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Acquiring lock "cinder-fd3dff8b-7cb2-4077-a5ef-24962e562258-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:36 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549101ae-791a-4329-b7f5-5d064472b4e3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 Apr 01 08:07:36 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "cinder-fd3dff8b-7cb2-4077-a5ef-24962e562258-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Acquiring lock "cinder-quobyte-fd3dff8b-7cb2-4077-a5ef-24962e562258" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "cinder-quobyte-fd3dff8b-7cb2-4077-a5ef-24962e562258" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7539c41-ed9e-4b78-a309-90c2b82bf253]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:36 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 Apr 01 08:07:36 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:36 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.665s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Deleted volume successfully. Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-33c997b7-cb7d-4b79-b999-586205c99afb tempest-VolumesGetTest-1842760555 None] Lock "cinder-18294aa7-147b-430f-b394-a47537487452-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:36 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549101ae-791a-4329-b7f5-5d064472b4e3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08" returned: 0 in 0.687s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:36 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 is being set with open permissions: ugo+rw Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:36 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 Apr 01 08:07:36 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:36 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258" returned: 0 in 0.688s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:36 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258 Apr 01 08:07:36 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:37 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08" returned: 0 in 0.689s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:37 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fd3dff8b-7cb2-4077-a5ef-24962e562258" returned: 0 in 0.603s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "cinder-quobyte-fd3dff8b-7cb2-4077-a5ef-24962e562258" released by "delete_volume" :: held 1.319s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:37 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info Apr 01 08:07:37 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Created reservations ['8b00af21-4d98-4b87-878f-41996f5cb996', 'ea8ef74c-e102-44a9-9ec0-15b6a76bc6b8', '0e6ee09b-9034-47c4-b50d-16afb6e57091', 'de1cdd2e-507c-4042-83a6-09a716dd71e2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:37 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:37 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:38 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info" returned: 0 in 0.575s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:38 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info is being set with open permissions: ugo+rw Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:38 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:38 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info Apr 01 08:07:38 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Deleted volume successfully. Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1f019306-a7b9-44f3-b22a-6882787a768e tempest-VolumesMetadataTest-378393749 None] Lock "cinder-fd3dff8b-7cb2-4077-a5ef-24962e562258-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:38 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.info" returned: 0 in 0.452s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.096s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-39dde215-a59c-442e-adac-aaf1525214ea tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Create snapshot completed successfully Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Flow 'volume_create_manager' (5f92ef75-f7f8-40e6-b34f-82ec65a6c8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ff9736-7063-46cd-9f60-d02196449b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ff9736-7063-46cd-9f60-d02196449b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-870765908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2819b7c-43e8-447d-a2b5-8b9b0a08d01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59255c38eab40cbb6b50130bad0321c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:39Z,use_quota=True,user_id='1c577204c1fa46888d9f229d648c1f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f80311-fb05-4837-918f-8adfc698fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f80311-fb05-4837-918f-8adfc698fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94e8eb-46d8-49b1-86ba-41a8a0795da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94e8eb-46d8-49b1-86ba-41a8a0795da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2819b7c-43e8-447d-a2b5-8b9b0a08d01f', 'volume_name': 'volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8b6b99-6970-4242-98b6-343776f27d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8b6b99-6970-4242-98b6-343776f27d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0730bf6-f13a-40b9-9bf8-06213cad669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:38 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f', 'volume_size': 1} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-870765908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2819b7c-43e8-447d-a2b5-8b9b0a08d01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59255c38eab40cbb6b50130bad0321c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:39Z,use_quota=True,user_id='1c577204c1fa46888d9f229d648c1f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Creating volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:38 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:38 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f 1073741824 Apr 01 08:07:38 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:39 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-49af1643-2936-424b-8810-ffc54967183c req-11927cfc-cde9-4be1-9f36-68e1ba478930 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Terminate volume connection completed successfully. Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-49af1643-2936-424b-8810-ffc54967183c req-11927cfc-cde9-4be1-9f36-68e1ba478930 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Deleting attachment c4556c33-eca7-4765-9e59-308b497eef9d. {{(pid=82084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "cinder-ed5c286d-2fe3-4b9a-8c69-95807645ed08-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-ed5c286d-2fe3-4b9a-8c69-95807645ed08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "cinder-quobyte-ed5c286d-2fe3-4b9a-8c69-95807645ed08" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-ed5c286d-2fe3-4b9a-8c69-95807645ed08" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:39 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Deleting offline snapshot ed5c286d-2fe3-4b9a-8c69-95807645ed08 of volume 549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] snapshot_file for this snap is: volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f 1073741824" returned: 0 in 0.641s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf7983-87e0-41a1-a145-25806391859c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:39 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f Apr 01 08:07:39 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:39 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 Apr 01 08:07:39 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:39 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" returned: 0 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0730bf6-f13a-40b9-9bf8-06213cad669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7670e7-b40b-461c-9341-bda103e5ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:40 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Volume volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f (c2819b7c-43e8-447d-a2b5-8b9b0a08d01f): created successfully Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7670e7-b40b-461c-9341-bda103e5ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Flow 'volume_create_manager' (5f92ef75-f7f8-40e6-b34f-82ec65a6c8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "cinder-5df092a8-cac3-4798-9478-65dc83b2b65e-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f5555f23-6fb7-45c9-807e-74f1d636704f tempest-VolumesSnapshotListTestJSON-301512428 None] Created volume successfully. Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-5df092a8-cac3-4798-9478-65dc83b2b65e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:40 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08" returned: 0 in 0.570s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-549101ae-791a-4329-b7f5-5d064472b4e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "cinder-quobyte-5df092a8-cac3-4798-9478-65dc83b2b65e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63ba6ff-b9b7-4c98-baa9-fa7bc6138d26]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-quobyte-5df092a8-cac3-4798-9478-65dc83b2b65e" acquired by "delete_volume" :: waited 0.025s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4585984-244a-4878-94d3-ef545f3eefc7]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:40 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 Apr 01 08:07:40 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:40 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:07:40 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:40 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 0.528s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:40 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3" returned: 0 in 0.627s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:40 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 Apr 01 08:07:40 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:40 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:07:40 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:41 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:41 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08 Apr 01 08:07:41 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:41 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 1 in 0.602s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Creating offline snapshot 5c942816-6657-41f5-9331-8d579475597a of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:07:41 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e Apr 01 08:07:41 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b71efc-80f1-4609-9ed2-6c2bb35465eb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:41 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f Apr 01 08:07:41 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:41 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3.ed5c286d-2fe3-4b9a-8c69-95807645ed08" returned: 0 in 0.449s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-ed5c286d-2fe3-4b9a-8c69-95807645ed08" released by "_delete_snapshot" :: held 2.191s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" released by "delete_snapshot" :: held 2.206s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:41 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Flow 'volume_create_manager' (30c28ba7-7466-46e3-9bc7-9699ae1633f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feac44ff-65d9-40a8-83af-97960dd7f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feac44ff-65d9-40a8-83af-97960dd7f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1433246298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c71afe7-f314-4183-b6eb-0473e8966014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b5e8ec5aeb426b8788a9d4d4bc1d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:42Z,use_quota=True,user_id='8825b6f98b1343138a2b0a58f1b15893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b58cc20-cae1-41a1-b58e-a21379685857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b58cc20-cae1-41a1-b58e-a21379685857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7d246-8fc0-45ad-bdd5-049708aced0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f7d246-8fc0-45ad-bdd5-049708aced0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c71afe7-f314-4183-b6eb-0473e8966014', 'volume_name': 'volume-7c71afe7-f314-4183-b6eb-0473e8966014', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694a85ae-efa2-4c5b-9b2e-531252af3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694a85ae-efa2-4c5b-9b2e-531252af3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465b68f1-9fb7-4799-b251-e8f3edbbd845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Volume 7c71afe7-f314-4183-b6eb-0473e8966014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c71afe7-f314-4183-b6eb-0473e8966014', 'volume_size': 1} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-5df092a8-cac3-4798-9478-65dc83b2b65e" returned: 0 in 0.504s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-quobyte-5df092a8-cac3-4798-9478-65dc83b2b65e" released by "delete_volume" :: held 1.676s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Created reservations ['cd562f6f-e053-4610-b1d2-34f213a1cc5d', '54c7666e-3f8e-4994-a547-b93459d75c66', '99fec043-cbad-4f90-95a9-417cdbb6a385', '42bdda29-8cae-4191-a263-943368fd5d12'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.quota [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Created reservations ['ee59e520-55fc-43e2-9824-48cfdf6df6af', '71d72cd1-13e5-45cd-a1d2-8b35090bfaf6', '6664a9da-f475-4396-8042-b2cf0707a533', '9308aea8-ac88-47c2-8b8b-75ceee570f77'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:41 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" returned: 0 in 0.552s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:41 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Delete snapshot completed successfully. Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-12e522cc-7635-4606-928e-30c2b2fdb9c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-ed5c286d-2fe3-4b9a-8c69-95807645ed08-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:41 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a 1G Apr 01 08:07:41 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:41 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:41 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:42 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.manager [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:42 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a 1G" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Deleted volume successfully. Apr 01 08:07:42 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:07:42 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-49af1643-2936-424b-8810-ffc54967183c req-f2ecd1ac-5915-4589-b06b-9d72ace982e3 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-5df092a8-cac3-4798-9478-65dc83b2b65e-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "cinder-549101ae-791a-4329-b7f5-5d064472b4e3-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-549101ae-791a-4329-b7f5-5d064472b4e3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfb8f8d-91b6-4e79-ae0e-80932fdffc80]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:42 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 Apr 01 08:07:42 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:42 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.463s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:42 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a is being set with open permissions: ugo+rw Apr 01 08:07:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:42 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:07:42 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:43 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:43 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3 Apr 01 08:07:43 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:43 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:43 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info Apr 01 08:07:43 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:43 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-549101ae-791a-4329-b7f5-5d064472b4e3" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-quobyte-549101ae-791a-4329-b7f5-5d064472b4e3" released by "delete_volume" :: held 0.948s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Created reservations ['f387a8cd-b0b6-4259-a2fb-11f7db9468b4', 'b1022d72-6987-4303-8a59-8f06ed41afc8', '8df65e38-806f-468f-8f25-5c2ba3b6f7ad', 'b8b46944-6ab0-4058-bba6-276ba02e7c30'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:43 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info" returned: 0 in 0.419s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:43 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info is being set with open permissions: ugo+rw Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:43 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info Apr 01 08:07:43 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:43 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:43 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:44 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.info" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1433246298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c71afe7-f314-4183-b6eb-0473e8966014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b5e8ec5aeb426b8788a9d4d4bc1d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:42Z,use_quota=True,user_id='8825b6f98b1343138a2b0a58f1b15893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Creating volume 7c71afe7-f314-4183-b6eb-0473e8966014 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:44 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:44 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 1073741824 Apr 01 08:07:44 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:44 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.474s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Deleted volume successfully. Apr 01 08:07:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fd29de17-d3f4-4a84-b5b3-3296b1c2f936 tempest-VolumesSnapshotListTestJSON-301512428 None] Create snapshot completed successfully Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e1fb3fec-cced-474b-9cbc-3889211bad0e tempest-VolumeSnapshotQuotasNegativeTestJSON-178808951 None] Lock "cinder-549101ae-791a-4329-b7f5-5d064472b4e3-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:44 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 1073741824" returned: 0 in 0.690s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:44 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 Apr 01 08:07:44 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:45 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.725s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465b68f1-9fb7-4799-b251-e8f3edbbd845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c71afe7-f314-4183-b6eb-0473e8966014', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4f8e58-f229-4eb4-b82d-b3982ee44de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Creating offline snapshot 6a54fab1-0a29-41e9-beb9-86de39b7aeb8 of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:07:45 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Volume volume-7c71afe7-f314-4183-b6eb-0473e8966014 (7c71afe7-f314-4183-b6eb-0473e8966014): created successfully Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4f8e58-f229-4eb4-b82d-b3982ee44de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Flow 'volume_create_manager' (30c28ba7-7466-46e3-9bc7-9699ae1633f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c387e4fc-ea48-4cff-94fc-30b62d79d477]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-43c89b9b-77fa-40bf-8d2a-67e59dd34a40 tempest-VolumesTransfersTest-43898793 None] Created volume successfully. Apr 01 08:07:45 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:07:45 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:45 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.558s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:45 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 1G Apr 01 08:07:45 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:46 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-cad17255-537d-497e-b87c-bed3e3fca87e tempest-VolumesTransfersTest-1647170628 None] Transfer volume completed successfully. Apr 01 08:07:46 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 1G" returned: 0 in 0.632s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:46 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:46 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:47 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.554s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:47 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 is being set with open permissions: ugo+rw Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:47 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:47 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "cinder-7c71afe7-f314-4183-b6eb-0473e8966014-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-7c71afe7-f314-4183-b6eb-0473e8966014-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "cinder-quobyte-7c71afe7-f314-4183-b6eb-0473e8966014" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-quobyte-7c71afe7-f314-4183-b6eb-0473e8966014" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7139193-476b-4a01-9730-bad7cfaae99d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:47 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 Apr 01 08:07:47 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:47 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.522s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:47 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-540a9547-7797-4f5b-ac6d-22964209ad2c tempest-VolumesSnapshotListTestJSON-301512428 None] Create snapshot completed successfully Apr 01 08:07:48 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014" returned: 0 in 0.604s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:48 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014 Apr 01 08:07:48 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:48 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7c71afe7-f314-4183-b6eb-0473e8966014" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-quobyte-7c71afe7-f314-4183-b6eb-0473e8966014" released by "delete_volume" :: held 1.089s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Created reservations ['17dc756c-b629-4db1-93f4-5ad4429fbeb0', '4aa3c3b9-afc1-4b46-bbc9-aba34d8c4c2e', '6cb68232-8412-4110-a7b7-703b43b40cf7', '83d2f389-0aed-4232-82c8-826bf5a044b6'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:48 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:48 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Creating offline snapshot 380b1f9d-02e1-4fe3-8a67-d51028aeced0 of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a268ba-9b95-4df1-9ca4-2be5dd6bf6d4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:49 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:49 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:49 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.462s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Deleted volume successfully. Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1619a0d3-5df3-4abe-9f38-46294151df0d tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-7c71afe7-f314-4183-b6eb-0473e8966014-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Flow 'volume_create_manager' (a5036a61-3a6a-449c-90fa-9b9794c6ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec02442-32a7-4e3d-bc6d-7f8530d4157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec02442-32a7-4e3d-bc6d-7f8530d4157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1835021549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2402c3-b100-46b0-ae41-cd8937c511e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2656e2c5e0946d882c0c3772a701f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:49Z,use_quota=True,user_id='7c131df330f5428498242eacb034ab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfec90b-af83-44f4-b34b-a46dbebeb9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfec90b-af83-44f4-b34b-a46dbebeb9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cd339f-a47f-469d-9fb1-6dcf3b507574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.image.glance [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Creating Keystone auth plugin from conf {{(pid=82084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 01 08:07:49 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.559s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:49 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 1G Apr 01 08:07:49 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cd339f-a47f-469d-9fb1-6dcf3b507574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de2402c3-b100-46b0-ae41-cd8937c511e6', 'volume_name': 'volume-de2402c3-b100-46b0-ae41-cd8937c511e6', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc05b51-ae1d-4a13-8903-873c93aa6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc05b51-ae1d-4a13-8903-873c93aa6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f78bd2-3c8b-40b4-853b-14eaa36ccc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:49 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Volume de2402c3-b100-46b0-ae41-cd8937c511e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de2402c3-b100-46b0-ae41-cd8937c511e6', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Trying to clone de2402c3-b100-46b0-ae41-cd8937c511e6 from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 at location (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]). {{(pid=82084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 01 08:07:49 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Image download 20.69 MB at 20.69 MB/s Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5287e-314d-43f7-9bb2-f64fdf36e7d1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:49 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD Apr 01 08:07:49 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Flow 'volume_create_manager' (ba82d2bc-908b-4400-94f2-b4417f70cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:50 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2a531e-3a48-483f-b75b-40597f39b5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 1G" returned: 0 in 0.670s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:50 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 Apr 01 08:07:50 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2a531e-3a48-483f-b75b-40597f39b5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047516638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac853a5-a546-47b9-a2f2-7332c6fcba2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b5e8ec5aeb426b8788a9d4d4bc1d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:50Z,use_quota=True,user_id='8825b6f98b1343138a2b0a58f1b15893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3880c6b6-a503-4855-8dc1-d789855f30eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3880c6b6-a503-4855-8dc1-d789855f30eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730869b-426b-4d44-8b07-7d8568ed49a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730869b-426b-4d44-8b07-7d8568ed49a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac853a5-a546-47b9-a2f2-7332c6fcba2b', 'volume_name': 'volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e1005-7c95-4473-b58f-a7a3d7e2ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e1005-7c95-4473-b58f-a7a3d7e2ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3a8106-30e6-4035-b784-4c4f48f9b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:50 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Volume 6ac853a5-a546-47b9-a2f2-7332c6fcba2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b', 'volume_size': 1} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:50 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 is fetched for user 7c131df330f5428498242eacb034ab48. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24186bc-ce2d-4968-aa42-4468c01a06c3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:50 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD Apr 01 08:07:50 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:50 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:50 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 is being set with open permissions: ugo+rw Apr 01 08:07:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:50 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 Apr 01 08:07:50 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:51 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD" returned: 0 in 0.555s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:51 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047516638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac853a5-a546-47b9-a2f2-7332c6fcba2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b5e8ec5aeb426b8788a9d4d4bc1d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:50Z,use_quota=True,user_id='8825b6f98b1343138a2b0a58f1b15893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Creating volume 6ac853a5-a546-47b9-a2f2-7332c6fcba2b {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:51 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:51 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b 1073741824 Apr 01 08:07:51 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4646b5d3-3cdb-4901-a32f-78f30b40c6ef tempest-VolumesSnapshotListTestJSON-301512428 None] Create snapshot completed successfully Apr 01 08:07:51 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b 1073741824" returned: 0 in 0.523s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:51 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b Apr 01 08:07:51 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:52 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" returned: 0 in 0.472s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1835021549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2402c3-b100-46b0-ae41-cd8937c511e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2656e2c5e0946d882c0c3772a701f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:07:49Z,use_quota=True,user_id='7c131df330f5428498242eacb034ab48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Creating volume de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:07:52 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3a8106-30e6-4035-b784-4c4f48f9b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:52 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1073741824 Apr 01 08:07:52 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99800fa3-ba7c-416a-a743-9b90d6068c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:52 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Volume volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b (6ac853a5-a546-47b9-a2f2-7332c6fcba2b): created successfully Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99800fa3-ba7c-416a-a743-9b90d6068c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Flow 'volume_create_manager' (ba82d2bc-908b-4400-94f2-b4417f70cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d6aafcb3-d759-4b43-be30-4ea817f8979e tempest-VolumesTransfersTest-43898793 None] Created volume successfully. Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-380b1f9d-02e1-4fe3-8a67-d51028aeced0-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-380b1f9d-02e1-4fe3-8a67-d51028aeced0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-380b1f9d-02e1-4fe3-8a67-d51028aeced0" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-380b1f9d-02e1-4fe3-8a67-d51028aeced0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Deleting offline snapshot 380b1f9d-02e1-4fe3-8a67-d51028aeced0 of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:07:52 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] snapshot_file for this snap is: volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1073741824" returned: 0 in 0.625s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315ab09-825b-4d64-b3d3-59c980676d30]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:52 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:07:52 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:52 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 Apr 01 08:07:52 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:53 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:53 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 0 in 0.452s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdbd5ba-ca50-4099-9269-57b3e5378e43]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Attempting download of 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume de2402c3-b100-46b0-ae41-cd8937c511e6. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd63d3-91e3-4387-b642-60750a8e9ead]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:53 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:53 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:53 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g Apr 01 08:07:53 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-2c6ce8a8-463c-4c68-bf88-c8959b8e3262 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Terminate volume connection completed successfully. Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-2c6ce8a8-463c-4c68-bf88-c8959b8e3262 tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Deleting attachment 6e410ee5-6a4d-4e68-8d7b-b58efe66286f. {{(pid=82084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "cinder-6ac853a5-a546-47b9-a2f2-7332c6fcba2b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-6ac853a5-a546-47b9-a2f2-7332c6fcba2b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "cinder-quobyte-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-quobyte-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:53 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g" returned: 0 in 0.522s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a20fa6-e827-4bf0-99a9-b8741a199d83]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:53 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.638s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:53 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 Apr 01 08:07:53 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:53 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g Apr 01 08:07:53 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:54 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b Apr 01 08:07:54 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "cinder-2f393005-0f8a-4a29-9b4b-740aed030d15-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-2f393005-0f8a-4a29-9b4b-740aed030d15-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "cinder-quobyte-2f393005-0f8a-4a29-9b4b-740aed030d15" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-quobyte-2f393005-0f8a-4a29-9b4b-740aed030d15" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b8fa6-cf56-4555-9b4b-5defb188ae82]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:54 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 Apr 01 08:07:54 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:54 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" returned: 0 in 0.572s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:54 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g" returned: 1 in 0.603s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_050mm01g' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[09051778-fc0e-4fa2-b52d-6d45b60a2843]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:54 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b Apr 01 08:07:54 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:54 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0" returned: 0 in 0.575s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:54 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0 Apr 01 08:07:54 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:54 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD Apr 01 08:07:54 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15" returned: 0 in 0.736s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:55 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.380b1f9d-02e1-4fe3-8a67-d51028aeced0" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15 Apr 01 08:07:55 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-380b1f9d-02e1-4fe3-8a67-d51028aeced0" released by "_delete_snapshot" :: held 2.245s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" released by "delete_snapshot" :: held 2.257s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD" returned: 0 in 0.550s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] 545c3f16-13af-4c88-b00b-d5d8aaf80866 was qcow2, converting to raw {{(pid=82084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:55 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" returned: 0 in 0.583s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:07:55 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-quobyte-6ac853a5-a546-47b9-a2f2-7332c6fcba2b" released by "delete_volume" :: held 1.207s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Created reservations ['37934c31-cdcc-4f98-a3c0-223f3e8f3c18', '55ccaa08-707c-4d46-bc55-8b2a0d040c1a', 'f509a9e3-9ed6-4238-8fac-e118b7b341ea', '8664f7ee-65be-4f94-bb05-86c20c71b101'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Delete snapshot completed successfully. Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4630e4e6-b041-4f00-b873-3062a5757a3a tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-380b1f9d-02e1-4fe3-8a67-d51028aeced0-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Created reservations ['76208742-2fd0-4dc4-9b96-07d961362104', 'e0782122-7f50-4c46-9679-cb3dd8cf475f', '5bff9903-0a2d-4987-a024-3c4dbcbc046c', '39171f8a-409e-4d8d-a2be-6a0154b6e621'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:55 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:55 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2f393005-0f8a-4a29-9b4b-740aed030d15" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-quobyte-2f393005-0f8a-4a29-9b4b-740aed030d15" released by "delete_volume" :: held 1.203s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.quota [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Created reservations ['5a7ed1d4-1197-4946-a18e-bdc19947b9f9', '3d5d615e-3cfd-4478-b250-d3d588f6238d', '86e159b6-99e7-4edf-8150-54cd80874de3', 'b3c39c8e-e1e2-48a7-8558-26b2e1b7640e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:55 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:55 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.478s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Deleted volume successfully. Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c4310904-854b-4bd7-a35e-cbd8b292905e tempest-VolumesTransfersTest-2082094530 None] Lock "cinder-6ac853a5-a546-47b9-a2f2-7332c6fcba2b-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:55 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:07:55 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-6a54fab1-0a29-41e9-beb9-86de39b7aeb8-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-6a54fab1-0a29-41e9-beb9-86de39b7aeb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-6a54fab1-0a29-41e9-beb9-86de39b7aeb8" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-6a54fab1-0a29-41e9-beb9-86de39b7aeb8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Deleting offline snapshot 6a54fab1-0a29-41e9-beb9-86de39b7aeb8 of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] snapshot_file for this snap is: volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f6b968-cf73-4dd0-abac-baed17be004b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:56 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 0 in 1.011s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_rvi6bm75devstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:07:56 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Converted 112.00 MB image at 110.51 MB/s Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:56 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1G Apr 01 08:07:56 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:56 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.584s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.manager [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:56 devstack cinder-volume[82084]: INFO cinder.volume.manager [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Deleted volume successfully. Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [req-a35d259a-48b5-4cb3-8fcc-411ac7630fc7 req-6b740411-5ae4-4076-9caa-33c21d6d1def tempest-ServerBootFromVolumeStableRescueTest-306685521 None] Lock "cinder-2f393005-0f8a-4a29-9b4b-740aed030d15-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:56 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:56 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:56 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.562s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:07:56 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.568s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:56 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 1G" returned: 0 in 0.563s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb66422-640e-433f-b9b2-55027db1965d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d46c21-3aaa-422b-bbac-5c76a4dfbfe8]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:56 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:07:56 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:56 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:07:56 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:57 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 0 in 0.663s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:57 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.698s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:57 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:57 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:57 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:07:57 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:57 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.604s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:57 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 1 in 0.650s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Downloaded image 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume de2402c3-b100-46b0-ae41-cd8937c511e6 successfully. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 for user 7c131df330f5428498242eacb034ab48 is deleted. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 01 08:07:57 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Marking volume de2402c3-b100-46b0-ae41-cd8937c511e6 as bootable. {{(pid=82084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 01 08:07:58 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8 Apr 01 08:07:58 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Copying metadata from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 to de2402c3-b100-46b0-ae41-cd8937c511e6. {{(pid=82084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Creating volume glance metadata for volume de2402c3-b100-46b0-ae41-cd8937c511e6 backed by image 545c3f16-13af-4c88-b00b-d5d8aaf80866 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f78bd2-3c8b-40b4-853b-14eaa36ccc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2402c3-b100-46b0-ae41-cd8937c511e6', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5638ab-496d-45ef-8ac4-a913738da894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:07:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Volume volume-de2402c3-b100-46b0-ae41-cd8937c511e6 (de2402c3-b100-46b0-ae41-cd8937c511e6): created successfully Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5638ab-496d-45ef-8ac4-a913738da894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Flow 'volume_create_manager' (a5036a61-3a6a-449c-90fa-9b9794c6ed94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:07:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-69201e44-f9d2-4fff-a880-52803c0e3f00 tempest-VolumesImageMetadata-1946227323 None] Created volume successfully. Apr 01 08:07:58 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.6a54fab1-0a29-41e9-beb9-86de39b7aeb8" returned: 0 in 0.492s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-6a54fab1-0a29-41e9-beb9-86de39b7aeb8" released by "_delete_snapshot" :: held 2.443s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" released by "delete_snapshot" :: held 2.464s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Created reservations ['48b4e68a-9834-4d28-a383-4204767631c0', 'a9aa115c-f76f-44e6-8785-894169c3b681', 'aa4b7769-2fd0-4ece-9c3f-dd950ef2da48', 'b6d03022-fe70-4c9b-b2f7-810909d20bbb'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:07:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Delete snapshot completed successfully. Apr 01 08:07:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7c530833-b46b-4eea-9852-c1d03833def7 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-6a54fab1-0a29-41e9-beb9-86de39b7aeb8-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-5c942816-6657-41f5-9331-8d579475597a-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-5c942816-6657-41f5-9331-8d579475597a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-5c942816-6657-41f5-9331-8d579475597a" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-5c942816-6657-41f5-9331-8d579475597a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Deleting offline snapshot 5c942816-6657-41f5-9331-8d579475597a of volume c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] snapshot_file for this snap is: volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40b76d-9220-4988-bc5e-5b50b82e6d0b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Acquiring lock "cinder-de2402c3-b100-46b0-ae41-cd8937c511e6-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "cinder-de2402c3-b100-46b0-ae41-cd8937c511e6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Acquiring lock "cinder-quobyte-de2402c3-b100-46b0-ae41-cd8937c511e6" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "cinder-quobyte-de2402c3-b100-46b0-ae41-cd8937c511e6" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a2731-c437-4157-82e0-ae1f7439ab24]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:59 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:07:59 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:59 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:07:59 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:07:59 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.637s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:07:59 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 0 in 0.510s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2dcfd2-c5f0-486b-8390-727b8f4d32cc]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:07:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:07:59 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f Apr 01 08:07:59 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:00 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:08:00 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:00 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" returned: 0 in 0.570s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:00 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:08:00 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:00 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 1 in 0.662s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:00 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6 Apr 01 08:08:00 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:00 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:00 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a Apr 01 08:08:00 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:01 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-de2402c3-b100-46b0-ae41-cd8937c511e6" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "cinder-quobyte-de2402c3-b100-46b0-ae41-cd8937c511e6" released by "delete_volume" :: held 1.667s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Created reservations ['88917ca0-c981-4658-a1f2-ac12f7f949d8', '3bd56a24-8e48-4fc1-90e6-3fb08255a486', '2772ef52-b26d-4af0-9f5a-1b3817408417', '421b829f-4a3c-4dd6-a9e3-74b7753d10b6'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:01 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:01 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Flow 'volume_create_manager' (1324f71e-abe9-4f95-a685-d3f7c8034463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef8543d-adb2-4ee5-93c0-9ec2564462ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef8543d-adb2-4ee5-93c0-9ec2564462ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-707517718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55cf38b-5d65-4108-948a-acced476a6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ccdc4801046e48199b12a629a0aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:01Z,use_quota=True,user_id='0ef2756e4ce14301a99822ccb61236d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a11beac-2ad1-4727-b66f-398bb1fd0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:01 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a11beac-2ad1-4727-b66f-398bb1fd0c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2bb5a6-ade3-4e0d-8afd-125b0413479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2bb5a6-ade3-4e0d-8afd-125b0413479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55cf38b-5d65-4108-948a-acced476a6a1', 'volume_name': 'volume-e55cf38b-5d65-4108-948a-acced476a6a1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d32039f-2ca7-40f1-ac77-39956d68084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d32039f-2ca7-40f1-ac77-39956d68084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406851f-7565-4a83-bc25-d4930ac9e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:01 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Volume e55cf38b-5d65-4108-948a-acced476a6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55cf38b-5d65-4108-948a-acced476a6a1', 'volume_size': 1} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-707517718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55cf38b-5d65-4108-948a-acced476a6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ccdc4801046e48199b12a629a0aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:01Z,use_quota=True,user_id='0ef2756e4ce14301a99822ccb61236d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Creating volume e55cf38b-5d65-4108-948a-acced476a6a1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:01 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f.5c942816-6657-41f5-9331-8d579475597a" returned: 0 in 0.547s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:01 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 1073741824 Apr 01 08:08:01 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-5c942816-6657-41f5-9331-8d579475597a" released by "_delete_snapshot" :: held 2.289s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" released by "delete_snapshot" :: held 2.303s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Created reservations ['c7b91a25-67e2-4004-ab43-d2372ab6d542', '94402da7-26bc-44e3-9161-05e22c583093', 'e3862e17-6df1-430a-90e8-5a9ec9853e60', 'd4546030-2b6f-4220-8a22-683b668cbb1f'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:01 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.465s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Deleted volume successfully. Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a8ee7791-639b-4e9e-892e-645aa0277574 tempest-VolumesImageMetadata-1946227323 None] Lock "cinder-de2402c3-b100-46b0-ae41-cd8937c511e6-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Delete snapshot completed successfully. Apr 01 08:08:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-528e4d62-f4b3-47a0-9788-7339ad50546f tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-5c942816-6657-41f5-9331-8d579475597a-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:02 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 1073741824" returned: 0 in 0.543s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:02 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 Apr 01 08:08:02 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:02 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406851f-7565-4a83-bc25-d4930ac9e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55cf38b-5d65-4108-948a-acced476a6a1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062a2f8b-1ae4-4ac6-b92a-a750b5e7184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:02 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Volume volume-e55cf38b-5d65-4108-948a-acced476a6a1 (e55cf38b-5d65-4108-948a-acced476a6a1): created successfully Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062a2f8b-1ae4-4ac6-b92a-a750b5e7184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Flow 'volume_create_manager' (1324f71e-abe9-4f95-a685-d3f7c8034463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" acquired by "delete_volume" :: waited 0.019s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e076df30-6170-4c19-aa70-900c45f8601e tempest-VolumesTransfersV355Test-574482518 None] Created volume successfully. Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf7aef-4dd9-4906-a026-a58fff1a42d5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:02 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f Apr 01 08:08:02 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:03 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" returned: 0 in 0.506s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:03 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f Apr 01 08:08:03 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Flow 'volume_create_manager' (72cb1aee-3532-479b-b2c9-64dc50967f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bcab21-ff67-4ce8-8ca5-f11d84f9e27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bcab21-ff67-4ce8-8ca5-f11d84f9e27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1753743333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07b656f-2919-400b-b265-efe5f50d1e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ad97d08c8b41fdb9735cb976b81f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:03Z,use_quota=True,user_id='5d4077a8dd2640bcaedc16672c78ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d8c23c-4559-43a1-93fd-2af4b8d349a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d8c23c-4559-43a1-93fd-2af4b8d349a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9986cc-4152-4358-8853-44cc20b84c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9986cc-4152-4358-8853-44cc20b84c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07b656f-2919-400b-b265-efe5f50d1e02', 'volume_name': 'volume-c07b656f-2919-400b-b265-efe5f50d1e02', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce62a20a-579a-418f-bebd-789552ab2f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce62a20a-579a-418f-bebd-789552ab2f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defab592-646e-4e4f-bb8b-96deb7eec4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:03 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Volume c07b656f-2919-400b-b265-efe5f50d1e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07b656f-2919-400b-b265-efe5f50d1e02', 'volume_size': 1} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1753743333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07b656f-2919-400b-b265-efe5f50d1e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ad97d08c8b41fdb9735cb976b81f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:03Z,use_quota=True,user_id='5d4077a8dd2640bcaedc16672c78ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Creating volume c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:03 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:03 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 1073741824 Apr 01 08:08:03 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:03 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" returned: 0 in 0.503s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-quobyte-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f" released by "delete_volume" :: held 1.051s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Created reservations ['3efc3ac6-da66-414d-9f10-ff0e90774fc1', 'cd3760b2-a7d6-4ef1-94c8-ef5d75235764', 'a765c875-9b71-43d9-bfb7-057c7af7fd98', 'beb89638-6b00-4693-9071-f27a6448f01f'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:03 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:03 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:04 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-16e3baed-9e63-4286-8c77-f071002074de tempest-VolumesTransfersV355Test-6116381 None] Transfer volume completed successfully. Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 1073741824" returned: 0 in 0.560s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:04 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 Apr 01 08:08:04 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:04 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Deleted volume successfully. Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e08bd91d-d509-4a81-8df2-672291394647 tempest-VolumesSnapshotListTestJSON-301512428 None] Lock "cinder-c2819b7c-43e8-447d-a2b5-8b9b0a08d01f-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:04 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02" returned: 0 in 0.429s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defab592-646e-4e4f-bb8b-96deb7eec4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07b656f-2919-400b-b265-efe5f50d1e02', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91956e77-9c02-426c-9e89-dcd70528311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:04 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Volume volume-c07b656f-2919-400b-b265-efe5f50d1e02 (c07b656f-2919-400b-b265-efe5f50d1e02): created successfully Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91956e77-9c02-426c-9e89-dcd70528311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Flow 'volume_create_manager' (72cb1aee-3532-479b-b2c9-64dc50967f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f50a49c6-5f52-46ce-b4b4-ce03d9354b9a tempest-SnapshotMetadataTestJSON-1827625292 None] Created volume successfully. Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "cinder-e55cf38b-5d65-4108-948a-acced476a6a1-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-e55cf38b-5d65-4108-948a-acced476a6a1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "cinder-quobyte-e55cf38b-5d65-4108-948a-acced476a6a1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-quobyte-e55cf38b-5d65-4108-948a-acced476a6a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aff7dd-f6f5-421f-8017-e5887b708814]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:05 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 Apr 01 08:08:05 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Creating offline snapshot 6d169bdf-1202-4c1e-94b0-92cdcb53d57b of volume c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:08:05 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1" returned: 0 in 0.623s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635514b-c4f7-4a0d-b0fd-e9ee8f71e16e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:05 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1 Apr 01 08:08:05 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:05 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 Apr 01 08:08:05 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:06 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e55cf38b-5d65-4108-948a-acced476a6a1" returned: 0 in 0.467s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-quobyte-e55cf38b-5d65-4108-948a-acced476a6a1" released by "delete_volume" :: held 1.132s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Created reservations ['d5285b98-514e-4be2-8c44-32b097d99004', 'f6a84d99-2ea9-4d81-aef3-b86637aa17ce', '57998728-5c12-4666-b890-160d2494ede4', 'da2a151b-efbe-406a-9c40-c87204ed87d8'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:06 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:06 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:06 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02" returned: 0 in 0.723s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:06 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b 1G Apr 01 08:08:06 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:06 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.504s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:06 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Deleted volume successfully. Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-46380741-6a02-48bf-9b7f-9c371195b006 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-e55cf38b-5d65-4108-948a-acced476a6a1-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Flow 'volume_create_manager' (7634f6da-3738-4a0b-8b95-295a230896e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0b9713-1d44-4c67-878c-8dd262772890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0b9713-1d44-4c67-878c-8dd262772890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-61019031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3324ecd-2d41-424e-894d-e2d8d8f2ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228c9ff22784bb2a8aea87049c08ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:07Z,use_quota=True,user_id='1f1e4aa3e6954bfc841b1cd860bf1e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a3ccd9-1f59-4f85-991c-6eaae4152563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a3ccd9-1f59-4f85-991c-6eaae4152563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26893a95-11e7-4995-913f-f967d842d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26893a95-11e7-4995-913f-f967d842d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3324ecd-2d41-424e-894d-e2d8d8f2ec95', 'volume_name': 'volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95', 'volume_size': 2}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb46e10-acf2-4f95-9973-4c3948e828ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb46e10-acf2-4f95-9973-4c3948e828ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887dcd01-e9da-4ab6-abcc-3f91504277a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Volume e3324ecd-2d41-424e-894d-e2d8d8f2ec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95', 'volume_size': 2} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:07 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b 1G" returned: 0 in 0.611s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07b656f-2919-400b-b265-efe5f50d1e02 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:07 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07b656f-2919-400b-b265-efe5f50d1e02 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b Apr 01 08:08:07 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Flow 'volume_create_manager' (273f8bf3-250c-4613-a242-9ea079eea921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e12e3c8-a2ba-4c39-8138-1fa11fb3b6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e12e3c8-a2ba-4c39-8138-1fa11fb3b6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-967045462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af42265-31ec-4716-a192-5a82d9dbc6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ccdc4801046e48199b12a629a0aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:08Z,use_quota=True,user_id='0ef2756e4ce14301a99822ccb61236d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c096b88-4139-48a1-990d-98c6a39b09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c096b88-4139-48a1-990d-98c6a39b09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72c2842-78c7-4158-be3d-3d904645ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72c2842-78c7-4158-be3d-3d904645ad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af42265-31ec-4716-a192-5a82d9dbc6cb', 'volume_name': 'volume-7af42265-31ec-4716-a192-5a82d9dbc6cb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059d99e9-7746-4a34-bd60-55dd73e13f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059d99e9-7746-4a34-bd60-55dd73e13f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eed4ac4-045c-40e6-b3c8-97e4aac82310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:07 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Volume 7af42265-31ec-4716-a192-5a82d9dbc6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af42265-31ec-4716-a192-5a82d9dbc6cb', 'volume_size': 1} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07b656f-2919-400b-b265-efe5f50d1e02 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b" returned: 0 in 0.558s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:07 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b is being set with open permissions: ugo+rw Apr 01 08:08:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:07 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b Apr 01 08:08:07 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:08 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:08 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info Apr 01 08:08:08 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:08 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:08 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info is being set with open permissions: ugo+rw Apr 01 08:08:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:08 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info Apr 01 08:08:08 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:09 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.info" returned: 0 in 0.421s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.266s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-61019031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3324ecd-2d41-424e-894d-e2d8d8f2ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f228c9ff22784bb2a8aea87049c08ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:07Z,use_quota=True,user_id='1f1e4aa3e6954bfc841b1cd860bf1e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Creating volume e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:09 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 2147483648 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:09 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 2147483648 Apr 01 08:08:09 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d6407ae8-365e-43f2-8169-1128c5005a15 tempest-SnapshotMetadataTestJSON-1827625292 None] Create snapshot completed successfully Apr 01 08:08:09 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:09 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 2147483648" returned: 0 in 0.528s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:09 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 Apr 01 08:08:09 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:10 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.333s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-967045462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af42265-31ec-4716-a192-5a82d9dbc6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21ccdc4801046e48199b12a629a0aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:08Z,use_quota=True,user_id='0ef2756e4ce14301a99822ccb61236d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Creating volume 7af42265-31ec-4716-a192-5a82d9dbc6cb {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:10 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887dcd01-e9da-4ab6-abcc-3f91504277a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95', 'volume_size': 2}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1cb980-f1e2-45a0-8c9b-c0e007e1a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:10 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb 1073741824 Apr 01 08:08:10 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:10 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Volume volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 (e3324ecd-2d41-424e-894d-e2d8d8f2ec95): created successfully Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1cb980-f1e2-45a0-8c9b-c0e007e1a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Flow 'volume_create_manager' (7634f6da-3738-4a0b-8b95-295a230896e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-86be963c-e034-432c-868b-f2497ab01e55 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Created volume successfully. Apr 01 08:08:10 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb 1073741824" returned: 0 in 0.538s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:10 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb Apr 01 08:08:10 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "cinder-6d169bdf-1202-4c1e-94b0-92cdcb53d57b-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-6d169bdf-1202-4c1e-94b0-92cdcb53d57b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "cinder-quobyte-6d169bdf-1202-4c1e-94b0-92cdcb53d57b" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-6d169bdf-1202-4c1e-94b0-92cdcb53d57b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Deleting offline snapshot 6d169bdf-1202-4c1e-94b0-92cdcb53d57b of volume c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] snapshot_file for this snap is: volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2783583-1b84-4fbb-bb11-8c585d19280e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:10 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b Apr 01 08:08:10 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:11 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb" returned: 0 in 0.458s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eed4ac4-045c-40e6-b3c8-97e4aac82310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af42265-31ec-4716-a192-5a82d9dbc6cb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc29107-6b11-4b7f-878c-6c45a5ce86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:11 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Volume volume-7af42265-31ec-4716-a192-5a82d9dbc6cb (7af42265-31ec-4716-a192-5a82d9dbc6cb): created successfully Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc29107-6b11-4b7f-878c-6c45a5ce86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Flow 'volume_create_manager' (273f8bf3-250c-4613-a242-9ea079eea921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ae823975-6b72-488b-87fe-015a3cc4a1d8 tempest-VolumesTransfersV355Test-574482518 None] Created volume successfully. Apr 01 08:08:11 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b" returned: 0 in 0.527s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c07b656f-2919-400b-b265-efe5f50d1e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee464ed-bac4-4054-975d-9956d2023ae7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Creating offline snapshot eaccf78e-41dd-49b7-93c6-563e2a91a398 of volume e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04fd7d2-dab9-4aab-a9c5-163ed665228b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:11 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 Apr 01 08:08:11 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:11 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 Apr 01 08:08:11 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:11 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02" returned: 0 in 0.522s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:11 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b Apr 01 08:08:11 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:12 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" returned: 0 in 0.516s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 2G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:12 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 2G Apr 01 08:08:12 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "cinder-7af42265-31ec-4716-a192-5a82d9dbc6cb-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-7af42265-31ec-4716-a192-5a82d9dbc6cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "cinder-quobyte-7af42265-31ec-4716-a192-5a82d9dbc6cb" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-quobyte-7af42265-31ec-4716-a192-5a82d9dbc6cb" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fffb388-b9d0-453f-ab67-5a1a9d07cf82]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:12 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb Apr 01 08:08:12 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:12 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 2G" returned: 0 in 0.581s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:12 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 Apr 01 08:08:12 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:12 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b" returned: 0 in 0.665s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:12 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b Apr 01 08:08:12 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:12 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb" returned: 0 in 0.523s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:12 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb Apr 01 08:08:12 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:13 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 is being set with open permissions: ugo+rw Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:13 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 Apr 01 08:08:13 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:13 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02.6d169bdf-1202-4c1e-94b0-92cdcb53d57b" returned: 0 in 0.488s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-6d169bdf-1202-4c1e-94b0-92cdcb53d57b" released by "_delete_snapshot" :: held 2.265s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" released by "delete_snapshot" :: held 2.277s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Created reservations ['526f1d4b-5b37-4847-bec2-08807d435cf5', '325a003a-816e-401a-a7fd-ae71e84b7e9f', '4f23f885-d435-4179-bb16-7f303540c833', '4fa101fc-75be-43e0-85ac-508cc534c7bf'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Delete snapshot completed successfully. Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f2a13949-4a26-418e-95fb-e22fa55ab1c2 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-6d169bdf-1202-4c1e-94b0-92cdcb53d57b-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:13 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7af42265-31ec-4716-a192-5a82d9dbc6cb" returned: 0 in 0.480s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-quobyte-7af42265-31ec-4716-a192-5a82d9dbc6cb" released by "delete_volume" :: held 1.043s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Created reservations ['59009dfe-96af-4ade-b62c-d3cc17903f48', 'ef1cebaf-45bc-4821-a100-65c05903b182', 'e4035a47-82bb-453c-ab0b-c29fcccfeb2c', '976fae74-afe0-4da8-aadf-69baa9befbc0'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:13 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:13 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:13 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:13 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info Apr 01 08:08:13 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:13 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Deleted volume successfully. Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-73a04828-bbdb-4f92-9307-193210fef177 tempest-VolumesTransfersV355Test-1480418477 None] Lock "cinder-7af42265-31ec-4716-a192-5a82d9dbc6cb-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:13 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:13 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info is being set with open permissions: ugo+rw Apr 01 08:08:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:13 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info Apr 01 08:08:13 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "cinder-c07b656f-2919-400b-b265-efe5f50d1e02-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-c07b656f-2919-400b-b265-efe5f50d1e02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a592b70-349a-4086-9a6d-554a68b683f9]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:14 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 Apr 01 08:08:14 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:14 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.info" returned: 0 in 0.470s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b85b37cf-546c-4406-bd52-8a08c4d8c5ca tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Create snapshot completed successfully Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "cinder-eaccf78e-41dd-49b7-93c6-563e2a91a398-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-eaccf78e-41dd-49b7-93c6-563e2a91a398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "cinder-quobyte-eaccf78e-41dd-49b7-93c6-563e2a91a398" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-eaccf78e-41dd-49b7-93c6-563e2a91a398" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Deleting offline snapshot eaccf78e-41dd-49b7-93c6-563e2a91a398 of volume e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] snapshot_file for this snap is: volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[43499b89-09b3-42b0-b1df-1ba3b728b26d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:14 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02" returned: 0 in 0.660s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:14 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02 Apr 01 08:08:14 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:14 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 Apr 01 08:08:14 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:15 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c07b656f-2919-400b-b265-efe5f50d1e02" returned: 0 in 0.468s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-quobyte-c07b656f-2919-400b-b265-efe5f50d1e02" released by "delete_volume" :: held 1.159s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Created reservations ['25570fa4-c1c5-4426-a74b-be88ca62dc00', '6d6157f1-48aa-432e-a501-fe8705087a4e', 'b8fd4e91-72fe-4698-979e-7ba01f50f667', 'd89ed591-0aa6-47ff-a5be-65772a552d57'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:15 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398" returned: 0 in 0.623s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f175968-abd7-4f42-a8a3-33d05044f097]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:15 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:15 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:15 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 Apr 01 08:08:15 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:15 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.527s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Deleted volume successfully. Apr 01 08:08:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c02d4c61-fb26-418d-9365-4a18ed2b1e38 tempest-SnapshotMetadataTestJSON-1827625292 None] Lock "cinder-c07b656f-2919-400b-b265-efe5f50d1e02-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:16 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" returned: 0 in 0.659s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:16 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 Apr 01 08:08:16 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:16 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398" returned: 0 in 0.605s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:16 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398 Apr 01 08:08:16 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:17 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95.eaccf78e-41dd-49b7-93c6-563e2a91a398" returned: 0 in 0.558s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-eaccf78e-41dd-49b7-93c6-563e2a91a398" released by "_delete_snapshot" :: held 2.532s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" released by "delete_snapshot" :: held 2.556s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Created reservations ['4bd79823-4fd3-4fec-badc-5029f9cbc1d5', '987542cc-da95-4c65-8371-47cc15413802', '6a62ea13-6568-417f-81b8-a4d8d675e5ff', 'd618b199-7c12-4020-bd50-3e7e3e276ea1'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:17 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Delete snapshot completed successfully. Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9b96d8f4-b35a-43bd-801a-60f398b4da94 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-eaccf78e-41dd-49b7-93c6-563e2a91a398-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "cinder-e3324ecd-2d41-424e-894d-e2d8d8f2ec95-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-e3324ecd-2d41-424e-894d-e2d8d8f2ec95-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" acquired by "delete_volume" :: waited 0.031s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f66348-ab15-4a8f-804d-16dfd28e831b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:18 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 Apr 01 08:08:18 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:18 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" returned: 0 in 0.705s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:18 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95 Apr 01 08:08:18 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:19 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" returned: 0 in 0.506s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-quobyte-e3324ecd-2d41-424e-894d-e2d8d8f2ec95" released by "delete_volume" :: held 1.255s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Created reservations ['f33ae8c7-f6d4-4ef7-8c76-7c5e5b4fed23', 'bbb8652b-8953-41dc-b5c1-cba718ef26e1', '92ca968b-44e2-48b3-91e0-85e2f353477c', '8ad139b5-f00e-4716-ab0e-002815388272'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:19 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:19 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Flow 'volume_create_manager' (257f40e2-beae-430b-9dc5-b22a1d635e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a12d6cf-18a5-4548-86fe-6537b5335d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a12d6cf-18a5-4548-86fe-6537b5335d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-178407749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75505f4a-26cb-43f2-a9d8-a5e6915c7e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfce5a9857514da7a8fcc072cb79f6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:20Z,use_quota=True,user_id='375fd9a5d9d84ae1b01c306954aaf0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c8bee1-a835-4007-b707-53db89f02817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c8bee1-a835-4007-b707-53db89f02817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d764dcb8-038c-43f8-b40c-a159faba6c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d764dcb8-038c-43f8-b40c-a159faba6c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75505f4a-26cb-43f2-a9d8-a5e6915c7e69', 'volume_name': 'volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af4c79f-90dc-42b4-8916-e840d47dff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af4c79f-90dc-42b4-8916-e840d47dff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae8b9ba-c1ff-4ea4-85b7-8e4ffb95a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Volume 75505f4a-26cb-43f2-a9d8-a5e6915c7e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69', 'volume_size': 1} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-178407749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75505f4a-26cb-43f2-a9d8-a5e6915c7e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfce5a9857514da7a8fcc072cb79f6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:20Z,use_quota=True,user_id='375fd9a5d9d84ae1b01c306954aaf0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Creating volume 75505f4a-26cb-43f2-a9d8-a5e6915c7e69 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:19 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:19 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 1073741824 Apr 01 08:08:19 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:19 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.504s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Deleted volume successfully. Apr 01 08:08:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44a3f7e4-a49f-4145-b7a2-248f8aa109d0 tempest-VolumesSnapshotNegativeTestJSON-1230431722 None] Lock "cinder-e3324ecd-2d41-424e-894d-e2d8d8f2ec95-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:20 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 1073741824" returned: 0 in 0.613s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:20 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 Apr 01 08:08:20 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:20 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" returned: 0 in 0.519s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae8b9ba-c1ff-4ea4-85b7-8e4ffb95a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f594a9f-2667-4c0f-9554-b4002def8f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Volume volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 (75505f4a-26cb-43f2-a9d8-a5e6915c7e69): created successfully Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f594a9f-2667-4c0f-9554-b4002def8f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Flow 'volume_create_manager' (257f40e2-beae-430b-9dc5-b22a1d635e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9c9364b4-b103-45ca-8df1-23ecd6bcfb41 tempest-VolumesTransfersV357Test-292261686 None] Created volume successfully. Apr 01 08:08:22 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=168,cinder:INSERT=58,cinder:UPDATE=213,cinder:DELETE=20 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:08:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7f875026-49c7-4e72-b9b8-5ae5d4fcfe3d tempest-VolumesTransfersV357Test-523433705 None] Transfer volume completed successfully. Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=234,cinder:SELECT=191,cinder:INSERT=78,cinder:DELETE=16 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (d5842710-e4a7-4f4d-a4b5-bf45bc68c0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd3aafb-b627-4fa5-ab92-4b9e1eea257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "cinder-75505f4a-26cb-43f2-a9d8-a5e6915c7e69-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd3aafb-b627-4fa5-ab92-4b9e1eea257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-730201989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13bbed78-d46a-4743-a25e-ae8f454500fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:23Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95594ba7-4c5b-4298-ba76-a98981c8c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95594ba7-4c5b-4298-ba76-a98981c8c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea1c21a-3cae-4b49-b78c-3efa8e79ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea1c21a-3cae-4b49-b78c-3efa8e79ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13bbed78-d46a-4743-a25e-ae8f454500fa', 'volume_name': 'volume-13bbed78-d46a-4743-a25e-ae8f454500fa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23845442-fb05-44c4-90c5-620fa5dcdba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23845442-fb05-44c4-90c5-620fa5dcdba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f664b-fea6-498f-a509-00beba8ed89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:23 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Volume 13bbed78-d46a-4743-a25e-ae8f454500fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13bbed78-d46a-4743-a25e-ae8f454500fa', 'volume_size': 1} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-730201989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13bbed78-d46a-4743-a25e-ae8f454500fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:23Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Creating volume 13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:23 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-75505f4a-26cb-43f2-a9d8-a5e6915c7e69-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "cinder-quobyte-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:23 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa 1073741824 Apr 01 08:08:23 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-quobyte-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279b64f-07d5-4600-86c8-e1807dc7b99d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:23 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 Apr 01 08:08:23 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:24 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa 1073741824" returned: 0 in 0.635s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:24 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" returned: 0 in 0.623s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:24 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:24 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:24 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69 Apr 01 08:08:24 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:24 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" returned: 0 in 0.599s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-quobyte-75505f4a-26cb-43f2-a9d8-a5e6915c7e69" released by "delete_volume" :: held 1.245s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:24 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Created reservations ['051f1352-6ba0-42d0-acec-f876d9551177', 'e0a71fa9-6b34-457f-b660-ac6f6562abdb', '089bd70f-1b58-432e-b9b4-ea1c47434257', '93f35c8a-7c36-47ce-9eec-572335e752b0'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:25 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.793s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f664b-fea6-498f-a509-00beba8ed89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13bbed78-d46a-4743-a25e-ae8f454500fa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1667061-db8f-45dd-b69f-515f38c9a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:25 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Volume volume-13bbed78-d46a-4743-a25e-ae8f454500fa (13bbed78-d46a-4743-a25e-ae8f454500fa): created successfully Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1667061-db8f-45dd-b69f-515f38c9a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:25 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (d5842710-e4a7-4f4d-a4b5-bf45bc68c0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:25 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:25 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a172dc17-5861-4d9f-a185-fff9a87b8bf1 tempest-VolumeDependencyTests-2053540244 None] Created volume successfully. Apr 01 08:08:25 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.582s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:25 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Deleted volume successfully. Apr 01 08:08:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a2d402b3-9a7c-437d-ab94-561eb1f69e8d tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-75505f4a-26cb-43f2-a9d8-a5e6915c7e69-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Creating offline snapshot 47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 of volume 13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad1177b-7c3e-49ae-8a23-0c6695ccc041]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:26 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:26 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Flow 'volume_create_manager' (7352e166-54b7-49ff-bc42-2467efe4b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541d5ee-e661-4a7b-9837-40159340d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541d5ee-e661-4a7b-9837-40159340d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523079064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be850e24-becf-4a29-bbdf-a5f4596bc2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfce5a9857514da7a8fcc072cb79f6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:26Z,use_quota=True,user_id='375fd9a5d9d84ae1b01c306954aaf0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87981466-1f28-4042-acaa-32ba8581eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87981466-1f28-4042-acaa-32ba8581eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e4086-d141-44b8-9aae-b52df94edc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e4086-d141-44b8-9aae-b52df94edc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be850e24-becf-4a29-bbdf-a5f4596bc2c7', 'volume_name': 'volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27135c22-cf2c-4a05-94f9-3d725ed57e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27135c22-cf2c-4a05-94f9-3d725ed57e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226990a0-f087-4c4e-83bc-f5c1e4c17272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:26 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Volume be850e24-becf-4a29-bbdf-a5f4596bc2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7', 'volume_size': 1} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:26 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.621s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:26 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 1G Apr 01 08:08:26 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:27 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 1G" returned: 0 in 0.731s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13bbed78-d46a-4743-a25e-ae8f454500fa -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:27 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13bbed78-d46a-4743-a25e-ae8f454500fa -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:27 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Flow 'volume_create_manager' (a5345562-5d5e-43fe-9c6e-d4468829d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce35523-6262-4ca2-8713-d3d9a45a78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce35523-6262-4ca2-8713-d3d9a45a78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071961428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55134d61-5d33-4030-b038-de8d8c57ef0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6bc42fbc774f29bfaa63642c2e3af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:28Z,use_quota=True,user_id='4471149d3106485abcd72599c2bb7282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5db849-5a05-4805-a1cc-38999bb277e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5db849-5a05-4805-a1cc-38999bb277e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786cd707-22c7-4b1f-b8bd-73ef17af2a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786cd707-22c7-4b1f-b8bd-73ef17af2a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55134d61-5d33-4030-b038-de8d8c57ef0b', 'volume_name': 'volume-55134d61-5d33-4030-b038-de8d8c57ef0b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e55af8a-c711-4427-b31b-9c9c103ba9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e55af8a-c711-4427-b31b-9c9c103ba9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b127be52-040f-47f5-8df3-70d0e2d08b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:27 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Volume 55134d61-5d33-4030-b038-de8d8c57ef0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55134d61-5d33-4030-b038-de8d8c57ef0b', 'volume_size': 1} Apr 01 08:08:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:28 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13bbed78-d46a-4743-a25e-ae8f454500fa -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 0.643s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:28 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 is being set with open permissions: ugo+rw Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:28 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:28 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:28 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:28 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info Apr 01 08:08:28 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:28 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info" returned: 0 in 0.470s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:28 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info is being set with open permissions: ugo+rw Apr 01 08:08:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:29 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info Apr 01 08:08:29 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:29 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.info" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.409s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.140s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523079064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be850e24-becf-4a29-bbdf-a5f4596bc2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfce5a9857514da7a8fcc072cb79f6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:26Z,use_quota=True,user_id='375fd9a5d9d84ae1b01c306954aaf0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Creating volume be850e24-becf-4a29-bbdf-a5f4596bc2c7 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:29 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:29 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 1073741824 Apr 01 08:08:29 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ffb03537-c9b9-4963-870f-5c088218f2f6 tempest-VolumeDependencyTests-2053540244 None] Create snapshot completed successfully Apr 01 08:08:29 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 1073741824" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:30 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 Apr 01 08:08:30 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:30 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7" returned: 0 in 0.549s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.885s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071961428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55134d61-5d33-4030-b038-de8d8c57ef0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6bc42fbc774f29bfaa63642c2e3af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:28Z,use_quota=True,user_id='4471149d3106485abcd72599c2bb7282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Creating volume 55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:30 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:30 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b 1073741824 Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226990a0-f087-4c4e-83bc-f5c1e4c17272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140577bc-ac44-437e-976c-737124ca7385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Volume volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 (be850e24-becf-4a29-bbdf-a5f4596bc2c7): created successfully Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140577bc-ac44-437e-976c-737124ca7385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Flow 'volume_create_manager' (7352e166-54b7-49ff-bc42-2467efe4b66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-16a71880-f0c1-4a30-9b6c-9c50f6554e6b tempest-VolumesTransfersV357Test-292261686 None] Created volume successfully. Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (1462d3fe-e59b-434a-bb2f-4293bbfa2458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7157e0-8651-4951-96cd-a03e93c72162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7157e0-8651-4951-96cd-a03e93c72162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1063756627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b03e1ca-569b-4714-baaa-88d22349b11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47587e9c-7bd6-4a7d-b24d-390cd5c2dc01,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:31Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bafc621-e1e8-4277-a111-59fdc9b5f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bafc621-e1e8-4277-a111-59fdc9b5f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601e8e3f-025e-441a-9869-936c52bdb588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601e8e3f-025e-441a-9869-936c52bdb588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b03e1ca-569b-4714-baaa-88d22349b11b', 'volume_name': 'volume-2b03e1ca-569b-4714-baaa-88d22349b11b', 'volume_size': 1, 'snapshot_id': '47587e9c-7bd6-4a7d-b24d-390cd5c2dc01'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2643a778-f9a0-4c3a-9f18-a0c8becc20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2643a778-f9a0-4c3a-9f18-a0c8becc20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b3080a-5220-45c9-b963-7faa7ddd005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:30 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Volume 2b03e1ca-569b-4714-baaa-88d22349b11b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b03e1ca-569b-4714-baaa-88d22349b11b', 'volume_size': 1, 'snapshot_id': '47587e9c-7bd6-4a7d-b24d-390cd5c2dc01'} Apr 01 08:08:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:31 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b 1073741824" returned: 0 in 1.015s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:31 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:08:31 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "cinder-be850e24-becf-4a29-bbdf-a5f4596bc2c7-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-be850e24-becf-4a29-bbdf-a5f4596bc2c7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "cinder-quobyte-be850e24-becf-4a29-bbdf-a5f4596bc2c7" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-quobyte-be850e24-becf-4a29-bbdf-a5f4596bc2c7" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6dbd4b-debc-4668-9ac2-470df2595d65]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:32 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 Apr 01 08:08:32 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:32 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.627s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.325s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-2b03e1ca-569b-4714-baaa-88d22349b11b" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b127be52-040f-47f5-8df3-70d0e2d08b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55134d61-5d33-4030-b038-de8d8c57ef0b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242b8d4c-31e4-4c84-8d5c-978f7e1701d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:32 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Volume volume-55134d61-5d33-4030-b038-de8d8c57ef0b (55134d61-5d33-4030-b038-de8d8c57ef0b): created successfully Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242b8d4c-31e4-4c84-8d5c-978f7e1701d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Flow 'volume_create_manager' (a5345562-5d5e-43fe-9c6e-d4468829d170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-2b03e1ca-569b-4714-baaa-88d22349b11b" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Creating volume 2b03e1ca-569b-4714-baaa-88d22349b11b from snapshot 47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] snapshot: 47587e9c-7bd6-4a7d-b24d-390cd5c2dc01, volume: 2b03e1ca-569b-4714-baaa-88d22349b11b, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:08:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3b99920b-8fb7-4429-bb11-af9dd974b240 tempest-VolumesActionsTest-1975353465 None] Created volume successfully. Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167abdd-aa22-4291-8522-6637083abbcb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:32 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:32 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:32 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7" returned: 0 in 0.646s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:32 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7 Apr 01 08:08:32 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:33 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 0.690s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13bbed78-d46a-4743-a25e-ae8f454500fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[01009129-0f1a-48e1-a5bf-f5d08f7442d3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:33 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-be850e24-becf-4a29-bbdf-a5f4596bc2c7" returned: 0 in 0.700s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:33 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:33 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-quobyte-be850e24-becf-4a29-bbdf-a5f4596bc2c7" released by "delete_volume" :: held 1.430s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Created reservations ['97c114a4-9216-413e-b783-f2c5e4f9882a', '673e4e26-641f-4c57-a613-5938fb775fc6', '26bd33f3-df46-4778-b13d-6c9215620c10', '63c28a8a-5e3e-4aef-85e2-58ea0f9e846f'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:33 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:33 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:34 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.846s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Deleted volume successfully. Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-dc6ccb03-ff7e-480c-820f-1fcc97fed543 tempest-VolumesTransfersV357Test-215761808 None] Lock "cinder-be850e24-becf-4a29-bbdf-a5f4596bc2c7-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:34 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 1.621s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:08:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:34 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b Apr 01 08:08:34 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:38 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b" returned: 0 in 3.688s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:38 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d41d28e-c55f-450a-9950-ad48371649de]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:38 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:38 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:39 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.951s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:39 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa, size 1024.00 MB, duration 3.69 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:08:39 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Converted 1024.00 MB image at 277.42 MB/s Apr 01 08:08:39 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b is being set with open permissions: ugo+rw Apr 01 08:08:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:39 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b Apr 01 08:08:39 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:40 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b" returned: 0 in 0.586s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" released by "_copy_volume_from_snapshot" :: held 7.684s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-2b03e1ca-569b-4714-baaa-88d22349b11b" released by "_create_volume_from_snapshot" :: held 7.713s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.794s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b3080a-5220-45c9-b963-7faa7ddd005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b03e1ca-569b-4714-baaa-88d22349b11b', 'volume_size': 1, 'snapshot_id': '47587e9c-7bd6-4a7d-b24d-390cd5c2dc01'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bfdadf-2d0b-4b71-855b-4729e929120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:40 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Volume volume-2b03e1ca-569b-4714-baaa-88d22349b11b (2b03e1ca-569b-4714-baaa-88d22349b11b): created successfully Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bfdadf-2d0b-4b71-855b-4729e929120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (1462d3fe-e59b-434a-bb2f-4293bbfa2458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-328d6230-d165-4e7b-a9d7-927818bd3464 tempest-VolumeDependencyTests-2053540244 None] Created volume successfully. Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Deleting offline snapshot 47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 of volume 13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] snapshot_file for this snap is: volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80103c1-44e7-4679-82e6-2eae2f92ecc8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:41 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:41 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Flow 'volume_create_manager' (e3facbdb-a3ae-42a8-99ae-e603bc1eb384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f841ff-25f9-4e1f-8e97-9ea54d598c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f841ff-25f9-4e1f-8e97-9ea54d598c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1394084145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abc1f24-7dda-4f7d-a6bd-443924c50a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029e74c9a09748bda071ee56cb148de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:42Z,use_quota=True,user_id='1e0d6a61a8a940d7800b2e7bf506801c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a354bd7-bb68-480b-aaba-76712f13f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a354bd7-bb68-480b-aaba-76712f13f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8932f39-818c-4a3e-b7e9-bb950c49c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.image.glance [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Creating Keystone auth plugin from conf {{(pid=82084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 01 08:08:42 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 1.134s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13bbed78-d46a-4743-a25e-ae8f454500fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2139a435-d89d-4772-a550-a69a8b2016ce]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8932f39-818c-4a3e-b7e9-bb950c49c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7abc1f24-7dda-4f7d-a6bd-443924c50a0a', 'volume_name': 'volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02f784-e1e5-4d8d-a4ef-f0b45885b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02f784-e1e5-4d8d-a4ef-f0b45885b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3443f41-dd2f-48cb-a25e-be24436e2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Trying to clone 7abc1f24-7dda-4f7d-a6bd-443924c50a0a from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 at location (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]). {{(pid=82084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 01 08:08:42 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:42 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 01 08:08:42 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Image download 20.69 MB at 20.69 MB/s Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e7094-cb78-4346-bf55-d927dbf28381]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:42 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD Apr 01 08:08:42 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:43 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.659s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:43 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:43 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:43 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 is fetched for user 1e0d6a61a8a940d7800b2e7bf506801c. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3100b-2b7e-421e-b006-fae8e7a32745]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:43 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD Apr 01 08:08:43 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:43 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:43 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01 Apr 01 08:08:43 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:43 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1394084145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abc1f24-7dda-4f7d-a6bd-443924c50a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029e74c9a09748bda071ee56cb148de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:42Z,use_quota=True,user_id='1e0d6a61a8a940d7800b2e7bf506801c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Creating volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:43 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:43 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1073741824 Apr 01 08:08:43 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:44 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa.47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" returned: 0 in 0.538s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01" released by "_delete_snapshot" :: held 2.944s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" released by "delete_snapshot" :: held 2.978s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Created reservations ['7a35ce69-db8c-43ce-b1f9-5d14e218eeea', 'fdaa9b1c-4dac-44e8-b29e-d0f56e239f10', '821e2f96-7713-4a93-8d1e-40d2b6b486a5', '4efec554-5de3-4e58-a122-4e78df44464b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Delete snapshot completed successfully. Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0590ca87-d8a0-4a12-9bbc-9799d3fde513 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-47587e9c-7bd6-4a7d-b24d-390cd5c2dc01-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-13bbed78-d46a-4743-a25e-ae8f454500fa-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-13bbed78-d46a-4743-a25e-ae8f454500fa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b973fa48-a38c-4cf4-a143-46507a143957]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:44 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:44 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:44 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1073741824" returned: 0 in 0.654s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:44 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:08:44 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:45 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 0.410s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:45 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.613s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Attempting download of 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 01 08:08:45 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa Apr 01 08:08:45 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a1c79-0caf-4c20-8825-3f4c287567cf]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:45 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x Apr 01 08:08:45 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:45 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-13bbed78-d46a-4743-a25e-ae8f454500fa" returned: 0 in 0.551s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-13bbed78-d46a-4743-a25e-ae8f454500fa" released by "delete_volume" :: held 1.219s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Created reservations ['0137101d-f641-4159-a64b-2a9e7eb2fa7e', 'aaf904a4-7d13-4911-baf8-d5a90dbcd605', '260469b9-1805-48c2-8dba-b6257efdaae1', 'a492f801-8bf6-4a63-8d55-48b959f665a4'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:45 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:45 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:45 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x" returned: 0 in 0.594s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:45 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x Apr 01 08:08:45 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:46 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.567s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:46 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Deleted volume successfully. Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3471ec7-f0fe-47c6-9fef-f1fc020de1d9 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-13bbed78-d46a-4743-a25e-ae8f454500fa-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:46 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x" returned: 1 in 0.713s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_545c3f16-13af-4c88-b00b-d5d8aaf80866_amc3uj0x' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[56939c11-325b-45b6-82de-b272e98eb378]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:46 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD Apr 01 08:08:46 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (c12b0057-1325-430d-b206-93f2949196df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a1d0f7-2278-4cf6-8b95-169f174f94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a1d0f7-2278-4cf6-8b95-169f174f94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258253705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6cdcc2-1d85-4a22-b772-056c866ad81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:47Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c02190e-2402-49c0-be03-5729cd4498c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c02190e-2402-49c0-be03-5729cd4498c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53b8039-8f58-428e-ada4-b5077d7b7eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53b8039-8f58-428e-ada4-b5077d7b7eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'volume_name': 'volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa67c03-38fb-4e19-8fae-0daba4246a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa67c03-38fb-4e19-8fae-0daba4246a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344f49da-26fd-45ad-a37b-8d40d7edf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:47 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Volume 0f6cdcc2-1d85-4a22-b772-056c866ad81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'volume_size': 1} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258253705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6cdcc2-1d85-4a22-b772-056c866ad81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:47Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Creating volume 0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:47 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:47 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f 1073741824 Apr 01 08:08:47 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:47 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD" returned: 0 in 1.284s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] 545c3f16-13af-4c88-b00b-d5d8aaf80866 was qcow2, converting to raw {{(pid=82084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 01 08:08:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:47 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:08:47 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:48 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f 1073741824" returned: 0 in 1.136s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:48 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:08:48 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Flow 'volume_create_manager' (93131c81-8cc5-4fcc-a7c2-5f37e99b905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89d3f3-2a17-4e01-b00e-1ed34b499d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89d3f3-2a17-4e01-b00e-1ed34b499d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1115723254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ddc95b-144a-45e2-8fcc-d2e431f6fcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e04b95bb7049569ff1e7d4646491ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:49Z,use_quota=True,user_id='2ae5adee8e994e3fa67efb7f3313b5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78d9943-2cbf-4909-943f-ee95ecad1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78d9943-2cbf-4909-943f-ee95ecad1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715274d6-d1ec-46cb-8e1f-6061eca0d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715274d6-d1ec-46cb-8e1f-6061eca0d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ddc95b-144a-45e2-8fcc-d2e431f6fcd0', 'volume_name': 'volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03af8573-6c6b-4a82-a301-70d49ef8460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03af8573-6c6b-4a82-a301-70d49ef8460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085d983d-c2f4-4218-bdeb-c2d53a950ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Volume 75ddc95b-144a-45e2-8fcc-d2e431f6fcd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0', 'volume_size': 1} Apr 01 08:08:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:49 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.648s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1115723254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ddc95b-144a-45e2-8fcc-d2e431f6fcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e04b95bb7049569ff1e7d4646491ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:49Z,use_quota=True,user_id='2ae5adee8e994e3fa67efb7f3313b5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Creating volume 75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:08:49 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:49 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 1073741824 Apr 01 08:08:49 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344f49da-26fd-45ad-a37b-8d40d7edf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a07431-4266-4134-8448-2b438f06983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:49 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Volume volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f (0f6cdcc2-1d85-4a22-b772-056c866ad81f): created successfully Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a07431-4266-4134-8448-2b438f06983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (c12b0057-1325-430d-b206-93f2949196df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-488d4711-e118-47e8-ad86-6c62c2d0c519 tempest-VolumeDependencyTests-2053540244 None] Created volume successfully. Apr 01 08:08:50 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 2.391s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:50 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_545c3f16-13af-4c88-b00b-d5d8aaf80866_ugdn8atedevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:08:50 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Converted 112.00 MB image at 46.82 MB/s Apr 01 08:08:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:50 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1G Apr 01 08:08:50 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:50 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 1073741824" returned: 0 in 0.878s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:50 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 Apr 01 08:08:50 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:51 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 1G" returned: 0 in 1.097s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:51 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" returned: 0 in 1.042s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[70554781-cb10-4ab8-9377-e2aac49100d1]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-324d29a2-77df-4bf5-8fcf-a49dcfdaeca5 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" by "attach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085d983d-c2f4-4218-bdeb-c2d53a950ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cf5d80-d0ba-4e4a-b310-7034c4a2603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-324d29a2-77df-4bf5-8fcf-a49dcfdaeca5 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" acquired by "attach_volume" :: waited 0.036s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Volume volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 (75ddc95b-144a-45e2-8fcc-d2e431f6fcd0): created successfully Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cf5d80-d0ba-4e4a-b310-7034c4a2603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Flow 'volume_create_manager' (93131c81-8cc5-4fcc-a7c2-5f37e99b905f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fdf338e6-d757-47c3-b3e4-4a51a66ad740 tempest-ServerRescueNegativeTestJSON-1399022239 None] Created volume successfully. Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (a92e72d4-7828-4017-ab34-3c10fe1d1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d495a-0ce0-49b9-addb-1aa957e11ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:08:51 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d495a-0ce0-49b9-addb-1aa957e11ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1494828124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac43617c-602a-4b6c-a973-4b78422e8977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9930f8c826cd4852b288c35f4812789e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0f6cdcc2-1d85-4a22-b772-056c866ad81f,status='creating',terminated_at=None,updated_at=2026-04-01T06:08:51Z,use_quota=True,user_id='5a94190f583d44dc89ce56b1c882f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0228e2b0-398f-45fe-8ef8-7d1344c44b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0228e2b0-398f-45fe-8ef8-7d1344c44b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fc682b-a8b1-4817-ad48-82c34901ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63fc682b-a8b1-4817-ad48-82c34901ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac43617c-602a-4b6c-a973-4b78422e8977', 'volume_name': 'volume-ac43617c-602a-4b6c-a973-4b78422e8977', 'volume_size': 1, 'source_volid': '0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2e44da-2623-4a21-950e-f1492f3db3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2e44da-2623-4a21-950e-f1492f3db3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeb32a0-22e7-4e68-bc6d-fe2f31c66d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Volume ac43617c-602a-4b6c-a973-4b78422e8977: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac43617c-602a-4b6c-a973-4b78422e8977', 'volume_size': 1, 'source_volid': '0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'source_volstatus': 'available'} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Cloning volume 0f6cdcc2-1d85-4a22-b772-056c866ad81f to volume ac43617c-602a-4b6c-a973-4b78422e8977 Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-324d29a2-77df-4bf5-8fcf-a49dcfdaeca5 tempest-VolumesActionsTest-1975353465 None] Attaching volume 55134d61-5d33-4030-b038-de8d8c57ef0b to instance 29b4abba-c30a-43ed-88f9-7b01c928dfff at mountpoint /dev/vdb on host None. Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Creating offline snapshot 9b92178a-3d5d-4966-af61-7f277c43ca96 of volume 0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:08:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-324d29a2-77df-4bf5-8fcf-a49dcfdaeca5 tempest-VolumesActionsTest-1975353465 None] Attach volume completed successfully. Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-324d29a2-77df-4bf5-8fcf-a49dcfdaeca5 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" released by "attach_volume" :: held 0.212s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a95b2f-675f-4636-91fb-2044d6fc7796]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:51 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:08:51 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1a637e7f-87f4-4c8a-9440-9b6454fb57d1 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" by "detach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1a637e7f-87f4-4c8a-9440-9b6454fb57d1 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1a637e7f-87f4-4c8a-9440-9b6454fb57d1 tempest-VolumesActionsTest-1975353465 None] Detaching volume 55134d61-5d33-4030-b038-de8d8c57ef0b from instance 29b4abba-c30a-43ed-88f9-7b01c928dfff. Apr 01 08:08:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1a637e7f-87f4-4c8a-9440-9b6454fb57d1 tempest-VolumesActionsTest-1975353465 None] Detach volume completed successfully. Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1a637e7f-87f4-4c8a-9440-9b6454fb57d1 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:08:52 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 0.834s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:52 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:08:52 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:52 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 1.000s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:52 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 1G Apr 01 08:08:52 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:53 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 1 in 0.902s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Downloaded image 545c3f16-13af-4c88-b00b-d5d8aaf80866 ((None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}])) to volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a successfully. {{(pid=82084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Temporary image 545c3f16-13af-4c88-b00b-d5d8aaf80866 for user 1e0d6a61a8a940d7800b2e7bf506801c is deleted. {{(pid=82084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.volume_utils [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Marking volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a as bootable. {{(pid=82084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Copying metadata from image 545c3f16-13af-4c88-b00b-d5d8aaf80866 to 7abc1f24-7dda-4f7d-a6bd-443924c50a0a. {{(pid=82084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Creating volume glance metadata for volume 7abc1f24-7dda-4f7d-a6bd-443924c50a0a backed by image 545c3f16-13af-4c88-b00b-d5d8aaf80866 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3443f41-dd2f-48cb-a25e-be24436e2221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a', 'volume_size': 1, 'image_id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/545c3f16-13af-4c88-b00b-d5d8aaf80866', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e7dfad3b1414178b417ebce3192735d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '545c3f16-13af-4c88-b00b-d5d8aaf80866', 'created_at': datetime.datetime(2026, 4, 1, 6, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 1, 6, 0, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/545c3f16-13af-4c88-b00b-d5d8aaf80866/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c531e68-5668-44c2-9975-6244f9167d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:08:53 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Volume volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a (7abc1f24-7dda-4f7d-a6bd-443924c50a0a): created successfully Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c531e68-5668-44c2-9975-6244f9167d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Flow 'volume_create_manager' (e3facbdb-a3ae-42a8-99ae-e603bc1eb384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:08:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b7fab758-4308-4296-b4f8-acd7e2c7a0c7 tempest-VolumesExtendTest-1914473977 None] Created volume successfully. Apr 01 08:08:53 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 1G" returned: 0 in 1.018s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:53 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:08:53 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:54 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.755s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:54 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 is being set with open permissions: ugo+rw Apr 01 08:08:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:54 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:08:54 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:54 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.535s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:54 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info Apr 01 08:08:54 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:55 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:55 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info is being set with open permissions: ugo+rw Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:55 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info Apr 01 08:08:55 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:55 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:08:55 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:56 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.info" returned: 0 in 0.621s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] snapshot: 9b92178a-3d5d-4966-af61-7f277c43ca96, volume: ac43617c-602a-4b6c-a973-4b78422e8977, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6a629e-4312-43b6-9ac5-689d1ecc7851]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:56 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:08:56 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:56 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.610s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:08:56 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a70f61-fca3-4d8d-afb5-6df3b9b1ec4c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:08:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:56 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:08:56 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:08:57 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 01 08:08:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.462s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:08:57 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:08:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:08:57 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 Apr 01 08:08:57 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:00 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977" returned: 0 in 3.216s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1b8bc-d01f-42ea-ae04-01493cb7b3ff]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:00 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:09:00 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:01 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.914s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f, size 1024.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:09:01 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Converted 1024.00 MB image at 318.20 MB/s Apr 01 08:09:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 is being set with open permissions: ugo+rw Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:01 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 Apr 01 08:09:01 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:01 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977" returned: 0 in 0.514s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" released by "_copy_volume_from_snapshot" :: held 5.673s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-9b92178a-3d5d-4966-af61-7f277c43ca96" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-9b92178a-3d5d-4966-af61-7f277c43ca96" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Deleting offline snapshot 9b92178a-3d5d-4966-af61-7f277c43ca96 of volume 0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] snapshot_file for this snap is: volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1812cc89-f082-46db-8203-f434adad0113]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:01 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:09:01 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:02 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:09:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6157e6-9414-4500-8fad-cad9787ce2ff]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:02 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:09:02 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:03 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.718s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:03 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:09:03 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:03 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=58,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=6 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:09:03 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.546s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:03 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96 Apr 01 08:09:03 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:04 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f.9b92178a-3d5d-4966-af61-7f277c43ca96" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-9b92178a-3d5d-4966-af61-7f277c43ca96" released by "_delete_snapshot" :: held 2.383s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.643s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.824s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeb32a0-22e7-4e68-bc6d-fe2f31c66d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac43617c-602a-4b6c-a973-4b78422e8977', 'volume_size': 1, 'source_volid': '0f6cdcc2-1d85-4a22-b772-056c866ad81f', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8407d6f-cea3-45c5-a93d-771cf482ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a606b08-735b-4c5e-862c-5c4812489875]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:04 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Volume volume-ac43617c-602a-4b6c-a973-4b78422e8977 (ac43617c-602a-4b6c-a973-4b78422e8977): created successfully Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8407d6f-cea3-45c5-a93d-771cf482ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Flow 'volume_create_manager' (a92e72d4-7828-4017-ab34-3c10fe1d1721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d422143d-c8bb-4215-b050-7857937d2bea tempest-VolumeDependencyTests-2053540244 None] Created volume successfully. Apr 01 08:09:04 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:09:04 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-0f6cdcc2-1d85-4a22-b772-056c866ad81f-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-0f6cdcc2-1d85-4a22-b772-056c866ad81f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-0f6cdcc2-1d85-4a22-b772-056c866ad81f" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-0f6cdcc2-1d85-4a22-b772-056c866ad81f" acquired by "delete_volume" :: waited 0.029s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faf5bbd-8594-4b0d-9c7b-bdb3cf3bf52f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:04 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:09:04 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:05 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 0.773s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:05 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:09:05 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:05 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.609s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:05 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f Apr 01 08:09:05 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:05 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 1 in 0.671s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 2G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a 2G" returned: 0 in 0.125s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.644s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-523daa5c-193b-45ee-a0c5-8ca15748fa1a tempest-VolumesExtendTest-1914473977 None] Extend volume completed successfully. Apr 01 08:09:06 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0f6cdcc2-1d85-4a22-b772-056c866ad81f" returned: 0 in 0.691s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-0f6cdcc2-1d85-4a22-b772-056c866ad81f" released by "delete_volume" :: held 1.343s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Created reservations ['b24921ba-7de2-4f39-8b6e-5d22469ae074', '950599c9-efb4-43a3-9443-db381e7d878d', '295d3723-405f-4285-94cb-1410d1c2c2a0', 'a0e035fe-2783-41f7-88c9-18ecb32669eb'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:06 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:06 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:06 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.637s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Deleted volume successfully. Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0031349e-4e1a-418d-a375-d983123502da tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-0f6cdcc2-1d85-4a22-b772-056c866ad81f-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-ac43617c-602a-4b6c-a973-4b78422e8977-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-ac43617c-602a-4b6c-a973-4b78422e8977-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-7abc1f24-7dda-4f7d-a6bd-443924c50a0a-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "cinder-7abc1f24-7dda-4f7d-a6bd-443924c50a0a-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" acquired by "delete_volume" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb492dc-c55e-44a9-ae4b-18ec9e37a07e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-quobyte-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" acquired by "delete_volume" :: waited 0.023s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8094fa-98fd-4d17-8d42-f778407f00a7]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:07 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 Apr 01 08:09:07 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:07 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:09:07 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:08 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977" returned: 0 in 1.232s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:08 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977 Apr 01 08:09:08 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:08 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 1.525s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Acquiring lock "cinder-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:08 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:09:08 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "cinder-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Acquiring lock "cinder-quobyte-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "cinder-quobyte-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" acquired by "delete_volume" :: waited 0.035s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e1a50-bdcd-4f94-843c-226ca3b69fe9]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:09 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ac43617c-602a-4b6c-a973-4b78422e8977" returned: 0 in 0.963s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:09 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 Apr 01 08:09:09 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-ac43617c-602a-4b6c-a973-4b78422e8977" released by "delete_volume" :: held 2.282s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Created reservations ['f6da56d6-3b3f-48c9-a60e-261cd3daaa24', 'bfc01d89-ad0c-4ffe-8678-16a8b9702779', '46a947d0-a20d-462c-8871-16247dbe584d', 'ca9b10ca-dc3c-4c34-a823-a77a6645ef03'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:09 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:09 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:10 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 1 in 1.149s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:10 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a Apr 01 08:09:10 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:10 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" returned: 0 in 0.908s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:10 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.597s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Deleted volume successfully. Apr 01 08:09:10 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0 Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-99ec90a7-e3dc-4df7-818a-eb34d03241e6 tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-ac43617c-602a-4b6c-a973-4b78422e8977-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:10 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-2b03e1ca-569b-4714-baaa-88d22349b11b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-2b03e1ca-569b-4714-baaa-88d22349b11b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" acquired by "delete_volume" :: waited 0.020s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b697a9-cb07-4791-b2ff-d9a094d02c27]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:10 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" returned: 0 in 0.774s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-7abc1f24-7dda-4f7d-a6bd-443924c50a0a" released by "delete_volume" :: held 3.558s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:10 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b Apr 01 08:09:10 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:10 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Created reservations ['963a6ff7-b026-4ccf-8295-5a50cfaf0c38', 'ca3cbf6a-9507-4417-bff2-21bb434f4505', 'd77e77d4-40ef-4b65-9e6e-d60ea8efd9f7', '3391dcd6-5c5c-4e43-a350-1cb6f469ab4f'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:11 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:11 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:11 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" returned: 0 in 0.905s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "cinder-quobyte-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0" released by "delete_volume" :: held 1.924s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Created reservations ['935b0f24-e593-423a-a60c-ee4b33cc5b08', '76711810-1315-4c3e-ab8b-b15756e9e735', '9c832329-5578-4c75-a0d7-13e3073fe201', 'f784ebc6-10f8-4a8c-96b6-8d966208be38'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:11 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b" returned: 0 in 0.557s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:11 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:11 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:11 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b Apr 01 08:09:11 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:11 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.896s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Deleted volume successfully. Apr 01 08:09:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af364a6c-0b0a-4043-a197-07625b0a419f tempest-VolumesExtendTest-1914473977 None] Lock "cinder-7abc1f24-7dda-4f7d-a6bd-443924c50a0a-delete_volume" released by "delete_volume" :: held 4.849s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:12 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Flow 'volume_create_manager' (c9b7c769-34c9-4a80-bf88-9c888b4e4dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:12 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933740bd-df12-4d55-a17a-d7f80c744ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 1.302s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2b03e1ca-569b-4714-baaa-88d22349b11b" returned: 0 in 1.289s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-quobyte-2b03e1ca-569b-4714-baaa-88d22349b11b" released by "delete_volume" :: held 1.948s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:12 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Deleted volume successfully. Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933740bd-df12-4d55-a17a-d7f80c744ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-993068575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d80dbf3-7f47-40fe-87bb-68887db2ba08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029e74c9a09748bda071ee56cb148de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:12Z,use_quota=True,user_id='1e0d6a61a8a940d7800b2e7bf506801c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b62964-1a04-46e0-a24b-4b4396f254df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b62964-1a04-46e0-a24b-4b4396f254df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df6c59d-183d-4174-9b5e-d7b8273ace3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df6c59d-183d-4174-9b5e-d7b8273ace3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d80dbf3-7f47-40fe-87bb-68887db2ba08', 'volume_name': 'volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe1b7ff-7bb3-4795-856f-f38c884b309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe1b7ff-7bb3-4795-856f-f38c884b309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066add26-edae-4b3e-8f35-7c74c1f3b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:12 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Volume 1d80dbf3-7f47-40fe-87bb-68887db2ba08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08', 'volume_size': 1} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-993068575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d80dbf3-7f47-40fe-87bb-68887db2ba08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029e74c9a09748bda071ee56cb148de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:12Z,use_quota=True,user_id='1e0d6a61a8a940d7800b2e7bf506801c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Creating volume 1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:12 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1512dd18-1a86-45d4-b6f3-0c9d7c0edc99 tempest-ServerRescueNegativeTestJSON-1399022239 None] Lock "cinder-75ddc95b-144a-45e2-8fcc-d2e431f6fcd0-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:12 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 1073741824 Apr 01 08:09:12 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Created reservations ['d8087199-1a5e-44be-a585-eee77e13bd94', 'fd21e61c-6354-46b4-ac4f-dea00c029367', 'b4d18095-3708-477a-b432-640cf8a704e5', '9145e06c-ff56-4977-89d7-39edeb8ab00c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:12 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:12 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:13 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.739s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:13 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Deleted volume successfully. Apr 01 08:09:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c2f23930-d9f2-4b09-9684-63794817b29c tempest-VolumeDependencyTests-2053540244 None] Lock "cinder-2b03e1ca-569b-4714-baaa-88d22349b11b-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:13 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 1073741824" returned: 0 in 1.155s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:13 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:13 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:14 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.682s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066add26-edae-4b3e-8f35-7c74c1f3b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d90b4c3-6c3c-4f2a-8d8e-294ec893266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Volume volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 (1d80dbf3-7f47-40fe-87bb-68887db2ba08): created successfully Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d90b4c3-6c3c-4f2a-8d8e-294ec893266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Flow 'volume_create_manager' (c9b7c769-34c9-4a80-bf88-9c888b4e4dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-29d78873-ba9e-4f66-a83a-4c1ee799db03 tempest-VolumesExtendTest-1914473977 None] Created volume successfully. Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Creating offline snapshot 47efc0f8-7dc9-46cc-a1b8-362db322a996 of volume 1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193847e-4417-40ca-9ee9-02bc7130bb20]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:16 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:16 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:16 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.521s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:16 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 1G Apr 01 08:09:16 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:17 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 1G" returned: 0 in 0.552s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:17 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 Apr 01 08:09:17 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:17 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996" returned: 0 in 0.536s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:17 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 is being set with open permissions: ugo+rw Apr 01 08:09:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:17 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 Apr 01 08:09:17 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:18 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:18 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info Apr 01 08:09:18 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:18 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info" returned: 0 in 0.621s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:18 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info is being set with open permissions: ugo+rw Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:18 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info Apr 01 08:09:18 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09dd803b-e4ae-4d55-bb88-ac531a3fce4b tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" by "attach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09dd803b-e4ae-4d55-bb88-ac531a3fce4b tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" acquired by "attach_volume" :: waited 0.026s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-09dd803b-e4ae-4d55-bb88-ac531a3fce4b tempest-VolumesActionsTest-1975353465 None] Attaching volume 55134d61-5d33-4030-b038-de8d8c57ef0b to instance 92d27969-6dfc-4f72-ac7e-3f7c486f0ff2 at mountpoint /dev/vdb on host None. Apr 01 08:09:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-09dd803b-e4ae-4d55-bb88-ac531a3fce4b tempest-VolumesActionsTest-1975353465 None] Attach volume completed successfully. Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09dd803b-e4ae-4d55-bb88-ac531a3fce4b tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b" released by "attach_volume" :: held 0.071s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:19 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.info" returned: 0 in 0.499s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.290s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ed52bac4-dcdc-44c4-a782-73d305b8b117 tempest-VolumesExtendTest-1914473977 None] Create snapshot completed successfully Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3db65349-9f46-4600-8f64-e0f51fcd064e tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" by "detach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3db65349-9f46-4600-8f64-e0f51fcd064e tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3db65349-9f46-4600-8f64-e0f51fcd064e tempest-VolumesActionsTest-1975353465 None] Detaching volume 55134d61-5d33-4030-b038-de8d8c57ef0b from instance 92d27969-6dfc-4f72-ac7e-3f7c486f0ff2. Apr 01 08:09:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3db65349-9f46-4600-8f64-e0f51fcd064e tempest-VolumesActionsTest-1975353465 None] Detach volume completed successfully. Apr 01 08:09:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3db65349-9f46-4600-8f64-e0f51fcd064e tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe49985-b051-4454-9fb9-ff58ab455a58]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:20 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:20 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:20 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.524s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 2G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 2G" returned: 0 in 0.085s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.671s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-755fc719-5dfb-4f00-989d-e3bc9a9fd33a tempest-VolumesExtendTest-1914473977 None] Extend volume completed successfully. Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-47efc0f8-7dc9-46cc-a1b8-362db322a996-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-47efc0f8-7dc9-46cc-a1b8-362db322a996-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-quobyte-47efc0f8-7dc9-46cc-a1b8-362db322a996" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-47efc0f8-7dc9-46cc-a1b8-362db322a996" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Deleting offline snapshot 47efc0f8-7dc9-46cc-a1b8-362db322a996 of volume 1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] snapshot_file for this snap is: volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c964e1ac-b1ed-44f6-8159-9896335392a0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:21 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 Apr 01 08:09:21 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:22 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996" returned: 0 in 0.611s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2740c1a4-8ca6-4238-a7d1-15059ef5d738]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:22 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:22 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:22 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.573s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:22 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 Apr 01 08:09:22 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:23 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:23 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996 Apr 01 08:09:23 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:23 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08.47efc0f8-7dc9-46cc-a1b8-362db322a996" returned: 0 in 0.409s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=96,cinder:UPDATE=101,cinder:INSERT=32,cinder:DELETE=11 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-47efc0f8-7dc9-46cc-a1b8-362db322a996" released by "_delete_snapshot" :: held 2.204s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" released by "delete_snapshot" :: held 2.219s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Created reservations ['573fcb07-9a53-4a2d-80db-3e394d2a1ace', 'ee5b3643-efc5-45d4-be3c-e51a50674e62', '0136000a-597a-4265-b4f6-4638029f9af1', '9d57b22a-b9ae-4cb3-b7b7-33f34c277c0e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Delete snapshot completed successfully. Apr 01 08:09:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52e76d4d-9412-4367-b458-8a5f33a385f0 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-47efc0f8-7dc9-46cc-a1b8-362db322a996-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-1d80dbf3-7f47-40fe-87bb-68887db2ba08-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-1d80dbf3-7f47-40fe-87bb-68887db2ba08-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1916604-17e8-4297-bb38-88648a5971f6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:24 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:24 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:25 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.577s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:25 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08 Apr 01 08:09:25 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:25 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-1d80dbf3-7f47-40fe-87bb-68887db2ba08" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-quobyte-1d80dbf3-7f47-40fe-87bb-68887db2ba08" released by "delete_volume" :: held 1.041s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Created reservations ['f7b13eea-bada-4c5f-8232-c15431167d31', 'f27450c5-b955-41c3-a306-45536195d6a6', '0c979535-0ad6-44db-895a-d2e8a4266df9', '10886cb0-dc6b-473f-9e2d-ec94f2a02783'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:25 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:25 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:26 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:26 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Deleted volume successfully. Apr 01 08:09:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b17e73c9-5980-41fd-ae7d-df76ae952716 tempest-VolumesExtendTest-1914473977 None] Lock "cinder-1d80dbf3-7f47-40fe-87bb-68887db2ba08-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:27 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e94997-1e95-47a5-bf41-ef45d1129ec0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:27 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:27 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:28 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.595s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:28 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd565255-344f-4a36-97d3-649fb9a647ce]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:28 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:28 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:29 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.634s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.4c4875e5-ba4a-4338-a2ce-c14baf7ca644ngrkw3bw.img {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:29 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.4c4875e5-ba4a-4338-a2ce-c14baf7ca644ngrkw3bw.img Apr 01 08:09:29 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:31 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.4c4875e5-ba4a-4338-a2ce-c14baf7ca644ngrkw3bw.img" returned: 0 in 2.352s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:31 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22fae1-b1ac-43e9-bb94-fe1166403b74]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:31 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:31 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:32 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (6c669a1a-ec14-4de0-9b0b-aa5287c48514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc72ac1-a821-4633-a43a-dade927f7a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc72ac1-a821-4633-a43a-dade927f7a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412845295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb928218-1361-4ce1-a0e7-31a159e867b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:32Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e54ddc-d456-4323-8c19-bb47a5fdf3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e54ddc-d456-4323-8c19-bb47a5fdf3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e72614-ae07-4b22-9bf3-57c8a8666fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e72614-ae07-4b22-9bf3-57c8a8666fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb928218-1361-4ce1-a0e7-31a159e867b5', 'volume_name': 'volume-eb928218-1361-4ce1-a0e7-31a159e867b5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68019fd2-aca7-4423-9aaa-7c4ddbaa69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68019fd2-aca7-4423-9aaa-7c4ddbaa69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb4340c-6e84-4f61-b723-fd2856dc2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:32 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume eb928218-1361-4ce1-a0e7-31a159e867b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb928218-1361-4ce1-a0e7-31a159e867b5', 'volume_size': 1} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.812s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.4c4875e5-ba4a-4338-a2ce-c14baf7ca644ngrkw3bw.img {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:09:32 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Converted 1024.00 MB image at 435.17 MB/s Apr 01 08:09:32 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] 4c4875e5-ba4a-4338-a2ce-c14baf7ca644 was raw, no need to convert to raw {{(pid=82084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 01 08:09:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f8bc0b4f-7f9c-40ef-a513-e7a5f27987b4 tempest-GroupsTest-1769182392 None] Group tempest-Group1-1286709001: creating Apr 01 08:09:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f8bc0b4f-7f9c-40ef-a513-e7a5f27987b4 tempest-GroupsTest-1769182392 None] Group tempest-Group1-1286709001: created successfully Apr 01 08:09:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f8bc0b4f-7f9c-40ef-a513-e7a5f27987b4 tempest-GroupsTest-1769182392 None] Create group completed successfully. Apr 01 08:09:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9cc287e8-fcb1-41b2-ad77-54c7c2f06c24 tempest-GroupsTest-1769182392 None] Group tempest-Group2-273523576: creating Apr 01 08:09:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9cc287e8-fcb1-41b2-ad77-54c7c2f06c24 tempest-GroupsTest-1769182392 None] Group tempest-Group2-273523576: created successfully Apr 01 08:09:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9cc287e8-fcb1-41b2-ad77-54c7c2f06c24 tempest-GroupsTest-1769182392 None] Create group completed successfully. Apr 01 08:09:37 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (af62a208-8f70-4681-9673-d673ce761322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddcf3b8-c6e5-4868-a3d7-c34dc091d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddcf3b8-c6e5-4868-a3d7-c34dc091d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681472192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=615dd9d3-f60e-451a-8f8b-1ee20ed312a1,host='devstack@QuobyteHD#QuobyteHD',id=d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:38Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01ed4f6d-5329-42db-9b56-2278b2e186d2),volume_type_id=01ed4f6d-5329-42db-9b56-2278b2e186d2)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12063ce-4955-4a30-82d8-cd5d2e486ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12063ce-4955-4a30-82d8-cd5d2e486ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fb2381-444b-4c97-832f-53a6514c4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fb2381-444b-4c97-832f-53a6514c4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1', 'volume_name': 'volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3bd65a-7b37-4747-bbf9-6170222ea81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3bd65a-7b37-4747-bbf9-6170222ea81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d98e36-3b88-4b4e-8cc8-6fadd0c10aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:38 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Volume d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1', 'volume_size': 1} Apr 01 08:09:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.482s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Uploaded volume to glance image-id: 4c4875e5-ba4a-4338-a2ce-c14baf7ca644. {{(pid=82084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.063s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412845295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb928218-1361-4ce1-a0e7-31a159e867b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:32Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume eb928218-1361-4ce1-a0e7-31a159e867b5 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:42 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:42 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 1073741824 Apr 01 08:09:42 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-46562c50-3a44-484c-899f-9cb0ceb1ba8f tempest-VolumesActionsTest-1975353465 None] Copy volume to image completed successfully. Apr 01 08:09:42 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 1073741824" returned: 0 in 0.452s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:42 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 Apr 01 08:09:42 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:43 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=615dd9d3-f60e-451a-8f8b-1ee20ed312a1,created_at=2026-04-01T06:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681472192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=615dd9d3-f60e-451a-8f8b-1ee20ed312a1,host='devstack@QuobyteHD#QuobyteHD',id=d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:38Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01ed4f6d-5329-42db-9b56-2278b2e186d2),volume_type_id=01ed4f6d-5329-42db-9b56-2278b2e186d2)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Creating volume d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:43 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb4340c-6e84-4f61-b723-fd2856dc2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb928218-1361-4ce1-a0e7-31a159e867b5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f03abe4-5132-4eda-94d5-8c80ccaab770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 1073741824 Apr 01 08:09:43 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-eb928218-1361-4ce1-a0e7-31a159e867b5 (eb928218-1361-4ce1-a0e7-31a159e867b5): created successfully Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f03abe4-5132-4eda-94d5-8c80ccaab770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (6c669a1a-ec14-4de0-9b0b-aa5287c48514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:43 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-aed9510d-a225-47d9-95a0-12ab4187a597 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:43 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 1073741824" returned: 0 in 0.495s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:43 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 Apr 01 08:09:43 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (2c402eaf-cc1a-4591-9b47-7e9021a9059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2265836-c697-4d43-b474-7d318116f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2265836-c697-4d43-b474-7d318116f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435671229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a57344-b686-4bfd-a30f-b34443a9f2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71ee158-e5de-4d1d-8329-b72231d0b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71ee158-e5de-4d1d-8329-b72231d0b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1d579-f92b-416d-8fd2-dd861f69db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1d579-f92b-416d-8fd2-dd861f69db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a57344-b686-4bfd-a30f-b34443a9f2db', 'volume_name': 'volume-f9a57344-b686-4bfd-a30f-b34443a9f2db', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3c2709-d466-47a7-931c-99b0d83f6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3c2709-d466-47a7-931c-99b0d83f6840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92d7eb3-a176-40d3-99b2-3b56351cfe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume f9a57344-b686-4bfd-a30f-b34443a9f2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a57344-b686-4bfd-a30f-b34443a9f2db', 'volume_size': 1} Apr 01 08:09:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:44 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" returned: 0 in 0.487s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.205s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d98e36-3b88-4b4e-8cc8-6fadd0c10aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c06b55-f3e2-4662-90d2-fb414bc5a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bde44e9-454e-44ec-8ee4-b41819cd5caa]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (a222364f-7f82-4c7c-a880-9049c81586ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a53ca9-9603-41dd-9e24-75feafb6a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a53ca9-9603-41dd-9e24-75feafb6a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579835422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a048a4f4-7a48-4c50-80d0-c5be61e6c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc221567-7917-448b-ab2f-5a6b61549f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc221567-7917-448b-ab2f-5a6b61549f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6811b197-0b8a-44ee-9fd1-416f4bf55156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6811b197-0b8a-44ee-9fd1-416f4bf55156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a048a4f4-7a48-4c50-80d0-c5be61e6c0c0', 'volume_name': 'volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0613af3f-0165-4ab8-a557-a1f965607bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0613af3f-0165-4ab8-a557-a1f965607bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8c4c89-901e-483f-8fde-03e41e015c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume a048a4f4-7a48-4c50-80d0-c5be61e6c0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0', 'volume_size': 1} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Volume volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 (d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1): created successfully Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c06b55-f3e2-4662-90d2-fb414bc5a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (af62a208-8f70-4681-9673-d673ce761322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:44 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:44 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-59d4cf1e-c7f9-4c8c-abab-d0c0264c0f83 tempest-GroupsTest-1769182392 None] Created volume successfully. Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (091cee27-3b3c-477d-ad5b-431129021640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0ff8cc-6345-480a-a3b9-d687f5348e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0ff8cc-6345-480a-a3b9-d687f5348e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260641862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270d3cf6-570d-4f49-b452-e1ce00e88363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633afc7f-5101-44bf-8ba2-ffbb576c7d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633afc7f-5101-44bf-8ba2-ffbb576c7d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d22ad0-c01b-48cb-af1f-e0a5f320abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d22ad0-c01b-48cb-af1f-e0a5f320abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270d3cf6-570d-4f49-b452-e1ce00e88363', 'volume_name': 'volume-270d3cf6-570d-4f49-b452-e1ce00e88363', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dadf581-3dc3-4dd5-a16c-fe7bdbb904f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dadf581-3dc3-4dd5-a16c-fe7bdbb904f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b2048d-c04e-4826-a934-6c50e2435c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume 270d3cf6-570d-4f49-b452-e1ce00e88363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270d3cf6-570d-4f49-b452-e1ce00e88363', 'volume_size': 1} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (e8d0e222-1225-4a54-9102-bfc1c2dab912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b02c1d-e2f3-402d-b3fd-f7d408fc9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b02c1d-e2f3-402d-b3fd-f7d408fc9369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819481670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464a5f4f-a9f4-4482-8138-8c8a2c80e6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:45Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18bfdcd-db70-413b-a046-fb2a69f52861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18bfdcd-db70-413b-a046-fb2a69f52861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00b42ac-71e0-4e43-a403-e57cce6b05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00b42ac-71e0-4e43-a403-e57cce6b05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464a5f4f-a9f4-4482-8138-8c8a2c80e6cf', 'volume_name': 'volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3025dd38-fd7e-4ae7-a151-ed55df4d84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3025dd38-fd7e-4ae7-a151-ed55df4d84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bfd631-874c-43c5-a8d8-fc159081754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume 464a5f4f-a9f4-4482-8138-8c8a2c80e6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf', 'volume_size': 1} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:44 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Acquiring lock "cinder-quobyte-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.581s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6e8e0-2b1e-4939-aac8-e3138782f542]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6328971a-a897-41f7-bc17-e95047834d55]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (c881be3e-d044-4319-bac8-b86a157c3621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5775f4-6db7-4f6e-befe-59fae3e81ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:44 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5775f4-6db7-4f6e-befe-59fae3e81ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573977038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff2819-2f3d-4dad-9d51-e11b355b7594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:45Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 Apr 01 08:09:44 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f148728f-d73d-46c8-9373-158df4a3e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f148728f-d73d-46c8-9373-158df4a3e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afeacde-59ce-4715-926c-fed69945d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afeacde-59ce-4715-926c-fed69945d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ff2819-2f3d-4dad-9d51-e11b355b7594', 'volume_name': 'volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7cb35f-8886-41b9-af0e-c6a5a31435fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7cb35f-8886-41b9-af0e-c6a5a31435fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f5e34-5e61-4570-aa4d-4b3a886ad3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume b7ff2819-2f3d-4dad-9d51-e11b355b7594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594', 'volume_size': 1} Apr 01 08:09:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:45 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:45 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" returned: 0 in 0.465s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:45 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img Apr 01 08:09:45 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:45 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1 Apr 01 08:09:45 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:45 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" returned: 0 in 0.548s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-d7b1fbec-cd08-4899-a8c4-1b50a1a6eaa1" released by "delete_volume" :: held 1.042s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:45 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Created reservations ['10c1d404-5440-4389-8387-8669ea441c8f'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:46 devstack cinder-volume[82084]: WARNING cinder.quota [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-620072805 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-620072805, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:09:46 devstack cinder-volume[82084]: WARNING cinder.quota [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-620072805 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-620072805, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Created reservations ['782a9009-8d9e-4e99-83ce-2eeaf57a61d8', '487506db-eb6f-4ac7-a38e-c5691118beb8', 'a0d97ece-a64d-4276-bfce-68a6cf6cd7d8', '9b15cb75-7023-4e32-a9d8-715b1598f018'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:46 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:46 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:47 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img" returned: 0 in 1.824s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:47 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.809s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:47 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-027ec4a9-0ca3-41c3-84a8-58c7a5cec315 tempest-GroupsTest-1769182392 None] Delete group completed successfully. Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047c1d1-50a1-452d-9660-a1753e8ec78a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:47 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:47 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:47 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.580s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:09:47 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Converted 1024.00 MB image at 560.93 MB/s Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] 894502a6-b92b-44e8-a152-29cf825d8237 was raw, converting to qcow2 {{(pid=82084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed776f0-b934-4d2c-b19c-2ce05ac18baf]: (4, 'raw') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:47 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img Apr 01 08:09:47 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Created reservations ['b933fef7-2ca1-4a56-82e1-3f318fd8996d'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:47 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:47 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:48 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:48 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img Apr 01 08:09:48 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:48 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-787b2460-bb82-41e6-8576-3935ed3220ac tempest-GroupsTest-1769182392 None] Delete group completed successfully. Apr 01 08:09:48 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img" returned: 1 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img' failed. Not Retrying. {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 01 08:09:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:48 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i Apr 01 08:09:48 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4416c599-4377-47a1-b248-070bb39bed82 tempest-GroupsTest-1769182392 None] Group tempest-GroupsTest-Group-311586933: creating Apr 01 08:09:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4416c599-4377-47a1-b248-070bb39bed82 tempest-GroupsTest-1769182392 None] Group tempest-GroupsTest-Group-311586933: created successfully Apr 01 08:09:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4416c599-4377-47a1-b248-070bb39bed82 tempest-GroupsTest-1769182392 None] Create group completed successfully. Apr 01 08:09:49 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i" returned: 0 in 0.419s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:49 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Image conversion details: src /opt/stack/data/cinder/conversion/55134d61-5d33-4030-b038-de8d8c57ef0b.temp_image.894502a6-b92b-44e8-a152-29cf825d8237zgaq53px.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:09:49 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 01 08:09:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[db19b1bb-0691-4cb2-9361-721c439f928a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:49 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i Apr 01 08:09:49 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:49 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_avl_bm8i" returned: 0 in 0.424s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (dfaa82ec-9cc5-4477-bc9a-e448a9ab54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c549a951-4f7e-4fe8-ba5b-2b81e66002ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c549a951-4f7e-4fe8-ba5b-2b81e66002ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220851075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,host='devstack@QuobyteHD#QuobyteHD',id=921dc6f1-1183-43d5-bfec-79678f943947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:50Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b6608c-4e1d-4226-beda-765bd0c004ba),volume_type_id=55b6608c-4e1d-4226-beda-765bd0c004ba)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a4f3c6-297b-4493-90fe-1767c6a879b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a4f3c6-297b-4493-90fe-1767c6a879b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39b122-f5cb-41a6-a2a3-b128e821874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39b122-f5cb-41a6-a2a3-b128e821874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921dc6f1-1183-43d5-bfec-79678f943947', 'volume_name': 'volume-921dc6f1-1183-43d5-bfec-79678f943947', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c32658b-a0d5-48f3-8d6d-81e15ce02de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c32658b-a0d5-48f3-8d6d-81e15ce02de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba61426-acbd-4de9-a9df-cf573ec59a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:50 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Volume 921dc6f1-1183-43d5-bfec-79678f943947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921dc6f1-1183-43d5-bfec-79678f943947', 'volume_size': 1} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.215s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Uploaded volume to glance image-id: 894502a6-b92b-44e8-a152-29cf825d8237. {{(pid=82084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.361s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435671229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a57344-b686-4bfd-a30f-b34443a9f2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume f9a57344-b686-4bfd-a30f-b34443a9f2db {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:50 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:50 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db 1073741824 Apr 01 08:09:50 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-13ba3a72-3917-47bd-9f38-87345aacb676 tempest-VolumesActionsTest-1975353465 None] Copy volume to image completed successfully. Apr 01 08:09:50 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db 1073741824" returned: 0 in 0.486s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:50 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db Apr 01 08:09:50 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:51 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.060s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579835422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a048a4f4-7a48-4c50-80d0-c5be61e6c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:51 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92d7eb3-a176-40d3-99b2-3b56351cfe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a57344-b686-4bfd-a30f-b34443a9f2db', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394a2f22-9d74-4106-99b5-19c9bc9f1da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:51 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 1073741824 Apr 01 08:09:51 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:51 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-f9a57344-b686-4bfd-a30f-b34443a9f2db (f9a57344-b686-4bfd-a30f-b34443a9f2db): created successfully Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394a2f22-9d74-4106-99b5-19c9bc9f1da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (2c402eaf-cc1a-4591-9b47-7e9021a9059b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-bd8de5d1-85ed-4558-ae3a-c83d0b5c87e5 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "cinder-quobyte-55134d61-5d33-4030-b038-de8d8c57ef0b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-quobyte-55134d61-5d33-4030-b038-de8d8c57ef0b" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b66b1d-1bbf-4ecd-9b45-e1119c3d3c8f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:51 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:51 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:51 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 1073741824" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:51 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 Apr 01 08:09:51 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:52 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.523s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:52 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b Apr 01 08:09:52 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:52 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" returned: 0 in 0.394s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.822s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260641862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270d3cf6-570d-4f49-b452-e1ce00e88363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:44Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume 270d3cf6-570d-4f49-b452-e1ce00e88363 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:52 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8c4c89-901e-483f-8fde-03e41e015c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cfac7a-9c24-46f9-a217-e160f0b70d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:52 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 (a048a4f4-7a48-4c50-80d0-c5be61e6c0c0): created successfully Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cfac7a-9c24-46f9-a217-e160f0b70d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (a222364f-7f82-4c7c-a880-9049c81586ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b761c9c2-4454-449e-a3a3-c89f6cf47ecc tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:52 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 1073741824 Apr 01 08:09:52 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:52 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-55134d61-5d33-4030-b038-de8d8c57ef0b" returned: 0 in 0.380s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-quobyte-55134d61-5d33-4030-b038-de8d8c57ef0b" released by "delete_volume" :: held 0.925s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Created reservations ['eb955ebf-e7a2-4ab7-a0dd-27e55cb8231e', '355be3e0-bdfd-427b-9e04-e0d554a30896', '4b8998e2-f401-422d-a325-de8727d9027f', 'c6a8d483-a6ba-4b8a-aaf6-dbbc609c2ac1'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:52 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:52 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:52 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 1073741824" returned: 0 in 0.540s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:52 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 Apr 01 08:09:52 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:53 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.403s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Deleted volume successfully. Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-26376f32-7f8a-477e-ad3e-95dc7005fa68 tempest-VolumesActionsTest-1975353465 None] Lock "cinder-55134d61-5d33-4030-b038-de8d8c57ef0b-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:53 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.598s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819481670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464a5f4f-a9f4-4482-8138-8c8a2c80e6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:45Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume 464a5f4f-a9f4-4482-8138-8c8a2c80e6cf {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:53 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b2048d-c04e-4826-a934-6c50e2435c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270d3cf6-570d-4f49-b452-e1ce00e88363', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfbe815-71a4-400a-986c-e899741c8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:53 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf 1073741824 Apr 01 08:09:53 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:53 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-270d3cf6-570d-4f49-b452-e1ce00e88363 (270d3cf6-570d-4f49-b452-e1ce00e88363): created successfully Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfbe815-71a4-400a-986c-e899741c8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (091cee27-3b3c-477d-ad5b-431129021640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-8d71f2ed-820c-407d-b378-8cc4c986bb72 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:53 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf 1073741824" returned: 0 in 0.516s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:53 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf Apr 01 08:09:53 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:54 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" returned: 0 in 0.414s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.296s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573977038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ff2819-2f3d-4dad-9d51-e11b355b7594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f34cfbc6448a793613050e01e8284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:45Z,use_quota=True,user_id='d34d8c1c63fb4ac3a736ff51e12bd059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Creating volume b7ff2819-2f3d-4dad-9d51-e11b355b7594 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:54 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bfd631-874c-43c5-a8d8-fc159081754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1758ad6f-69f1-4338-a8d9-26e0df67c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:54 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 1073741824 Apr 01 08:09:54 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:54 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf (464a5f4f-a9f4-4482-8138-8c8a2c80e6cf): created successfully Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1758ad6f-69f1-4338-a8d9-26e0df67c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (e8d0e222-1225-4a54-9102-bfc1c2dab912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:54 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-831d047e-a46c-4668-907f-877aeb562e39 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:54 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 1073741824" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:54 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 Apr 01 08:09:54 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:55 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.824s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,created_at=2026-04-01T06:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220851075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,host='devstack@QuobyteHD#QuobyteHD',id=921dc6f1-1183-43d5-bfec-79678f943947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:50Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b6608c-4e1d-4226-beda-765bd0c004ba),volume_type_id=55b6608c-4e1d-4226-beda-765bd0c004ba)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Creating volume 921dc6f1-1183-43d5-bfec-79678f943947 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:55 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f5e34-5e61-4570-aa4d-4b3a886ad3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:55 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 1073741824 Apr 01 08:09:55 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffba369-8964-49de-b887-546b24202b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:55 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Volume volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 (b7ff2819-2f3d-4dad-9d51-e11b355b7594): created successfully Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffba369-8964-49de-b887-546b24202b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Flow 'volume_create_manager' (c881be3e-d044-4319-bac8-b86a157c3621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-353fa5dc-1995-48b5-991c-736d1dddfa2d tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created volume successfully. Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-b7ff2819-2f3d-4dad-9d51-e11b355b7594-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:55 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 1073741824" returned: 0 in 0.519s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-b7ff2819-2f3d-4dad-9d51-e11b355b7594-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:55 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 Apr 01 08:09:55 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-b7ff2819-2f3d-4dad-9d51-e11b355b7594" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-b7ff2819-2f3d-4dad-9d51-e11b355b7594" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f67adb-969b-4694-a913-a7a227e8abf1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:55 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 Apr 01 08:09:55 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:55 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:55 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:56 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947" returned: 0 in 0.476s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba61426-acbd-4de9-a9df-cf573ec59a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921dc6f1-1183-43d5-bfec-79678f943947', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e685d8-bd64-4785-90c2-8dc5d427b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Volume volume-921dc6f1-1183-43d5-bfec-79678f943947 (921dc6f1-1183-43d5-bfec-79678f943947): created successfully Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e685d8-bd64-4785-90c2-8dc5d427b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (dfaa82ec-9cc5-4477-bc9a-e448a9ab54e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:56 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e2eb41c5-0442-43e7-9daf-ae6701e41af2 tempest-GroupsTest-1769182392 None] Created volume successfully. Apr 01 08:09:56 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594" returned: 0 in 0.509s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:56 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594 Apr 01 08:09:56 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:56 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:56 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b7ff2819-2f3d-4dad-9d51-e11b355b7594" returned: 0 in 0.404s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-b7ff2819-2f3d-4dad-9d51-e11b355b7594" released by "delete_volume" :: held 0.939s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['aa485bd9-9436-4547-ae00-cb0348a5809b', '01a0e0ac-55c3-4bb8-8f10-ba721b3e32ed', '98629996-1ff8-4faf-a0e1-8bbc8540937d', 'e444913c-984d-4dde-8628-059c883b42f0'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:56 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:56 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (e0138526-fef0-43aa-9c9d-5165d344dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d443bf16-71de-4c8c-9982-a11e21acefa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" acquired by "delete_volume" :: waited 0.043s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d443bf16-71de-4c8c-9982-a11e21acefa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283243112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2144503b-0777-4489-a6dc-1097f323913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a81077-20b1-40ba-86f8-57bd5bc74dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a81077-20b1-40ba-86f8-57bd5bc74dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca67858-f9ea-45f2-9fa7-39f8b521a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca67858-f9ea-45f2-9fa7-39f8b521a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2144503b-0777-4489-a6dc-1097f323913d', 'volume_name': 'volume-2144503b-0777-4489-a6dc-1097f323913d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba88eaf-a840-4890-8f76-528bba80826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba88eaf-a840-4890-8f76-528bba80826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1221bf23-599f-4f91-9362-5f586a7a1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Volume 2144503b-0777-4489-a6dc-1097f323913d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2144503b-0777-4489-a6dc-1097f323913d', 'volume_size': 1} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283243112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2144503b-0777-4489-a6dc-1097f323913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Creating volume 2144503b-0777-4489-a6dc-1097f323913d {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d95f8d-55f6-46b4-b0d5-b4939a54a9c2]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:57 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d 1073741824 Apr 01 08:09:57 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:57 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf Apr 01 08:09:57 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (4c7c088b-5841-40af-a179-46c15cf52193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8f7298-7ac3-4edc-9eec-29faf92991ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8f7298-7ac3-4edc-9eec-29faf92991ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1740984359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,host='devstack@QuobyteHD#QuobyteHD',id=84f8d95b-4552-419c-8d19-1af9fca6a1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b6608c-4e1d-4226-beda-765bd0c004ba),volume_type_id=55b6608c-4e1d-4226-beda-765bd0c004ba)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27906e8-de79-43aa-8c2a-511dff0c4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27906e8-de79-43aa-8c2a-511dff0c4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68c6cca-a21f-4663-8f88-eb424c2090ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68c6cca-a21f-4663-8f88-eb424c2090ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f8d95b-4552-419c-8d19-1af9fca6a1d3', 'volume_name': 'volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f181efe-84d5-43be-a976-25b65071ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f181efe-84d5-43be-a976-25b65071ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1695c06-90dd-41f1-abae-96152aca2569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Volume 84f8d95b-4552-419c-8d19-1af9fca6a1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3', 'volume_size': 1} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (65f7a2e4-ea03-4ba0-a6ba-9e7d29d7aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c93bd3-1f8e-4a9f-8493-7d6a8f2ab08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c93bd3-1f8e-4a9f-8493-7d6a8f2ab08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867639609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb926c5-7de5-41da-bb2b-c439dbd7a4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40dabe1-3492-4bed-a40d-324685eb7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40dabe1-3492-4bed-a40d-324685eb7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f738abb-6ef6-4e42-9e18-2afc20ef3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f738abb-6ef6-4e42-9e18-2afc20ef3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb926c5-7de5-41da-bb2b-c439dbd7a4a8', 'volume_name': 'volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ab895a-a78f-499e-9682-4c4f36b0a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ab895a-a78f-499e-9682-4c4f36b0a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f344fc45-8edc-4c3d-83d4-be9384e5b3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Volume 0cb926c5-7de5-41da-bb2b-c439dbd7a4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8', 'volume_size': 1} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:57 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (2f92888c-4a87-4bc1-836a-30e9d18fb61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5544d9-13e9-4be5-b983-81f7a1f7132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.796s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5544d9-13e9-4be5-b983-81f7a1f7132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1595921946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094517e1-1989-4a60-9502-5b4e15a0b2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e7c049-b933-448c-85bf-e04b02b4b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e7c049-b933-448c-85bf-e04b02b4b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637233be-b0e9-4637-956f-0bb625cda4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637233be-b0e9-4637-956f-0bb625cda4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094517e1-1989-4a60-9502-5b4e15a0b2c6', 'volume_name': 'volume-094517e1-1989-4a60-9502-5b4e15a0b2c6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8c69f-8249-458d-ad57-d5ed438f3c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8c69f-8249-458d-ad57-d5ed438f3c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef117a3-7e3c-4d7a-aa17-265f98306832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Volume 094517e1-1989-4a60-9502-5b4e15a0b2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094517e1-1989-4a60-9502-5b4e15a0b2c6', 'volume_size': 1} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-992bf62f-38a0-4050-bf4d-5a18e0cec946 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-b7ff2819-2f3d-4dad-9d51-e11b355b7594-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (b3901abf-d491-4a57-badd-d2433c474b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f96aaae-e78a-48fe-b405-8690c93ecd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f96aaae-e78a-48fe-b405-8690c93ecd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769788357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5121064-cfa4-414a-b93a-b56b88c82f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:58Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11173c21-d8b6-4ac2-b98e-9e9b304317ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11173c21-d8b6-4ac2-b98e-9e9b304317ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf954064-21a3-4a0f-9334-a6701dbe8f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf954064-21a3-4a0f-9334-a6701dbe8f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5121064-cfa4-414a-b93a-b56b88c82f79', 'volume_name': 'volume-c5121064-cfa4-414a-b93a-b56b88c82f79', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a0228-810a-48f5-bdd7-33d051edce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a0228-810a-48f5-bdd7-33d051edce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39dedf2-65d9-473e-ac94-e6fe769f4564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Volume c5121064-cfa4-414a-b93a-b56b88c82f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5121064-cfa4-414a-b93a-b56b88c82f79', 'volume_size': 1} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" returned: 0 in 0.801s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:57 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d 1073741824" returned: 0 in 0.840s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:57 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf Apr 01 08:09:57 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:57 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d Apr 01 08:09:57 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (2ab3f288-bf2c-40a8-b1d8-fee66ae20a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68baba2-880f-44be-ae7f-3954c9791de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68baba2-880f-44be-ae7f-3954c9791de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-444771024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94155568-7312-4e53-84be-f1ad7aecde86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:58Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df01fe7a-2ec7-446a-bacf-eca4593d875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df01fe7a-2ec7-446a-bacf-eca4593d875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37000ff-984c-4c76-bc48-750252420315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37000ff-984c-4c76-bc48-750252420315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94155568-7312-4e53-84be-f1ad7aecde86', 'volume_name': 'volume-94155568-7312-4e53-84be-f1ad7aecde86', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5c716-5770-49b0-ad26-a555aefba9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab5c716-5770-49b0-ad26-a555aefba9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48d6dbb-ac45-4665-a6cb-b32f58c415d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Volume 94155568-7312-4e53-84be-f1ad7aecde86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94155568-7312-4e53-84be-f1ad7aecde86', 'volume_size': 1} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:58 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf" released by "delete_volume" :: held 1.312s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['0b1a34d5-acaa-4faa-8a98-93c6b47c0166', 'b5ad7ac3-901b-4da0-8249-10fcdba243c0', '3b1ace6a-a5a9-4aa0-b39e-2bd126866ae7', '018ad4de-7fc6-41ca-b9a6-d1e4d2c8b4be'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:09:58 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1740984359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c5a2245-e97f-4e42-b4d5-354cf8288f5c,host='devstack@QuobyteHD#QuobyteHD',id=84f8d95b-4552-419c-8d19-1af9fca6a1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08588736eb5f447191ed3c62ddb9098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='aacfdedaa31641659a89571bfbeb52c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b6608c-4e1d-4226-beda-765bd0c004ba),volume_type_id=55b6608c-4e1d-4226-beda-765bd0c004ba)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Creating volume 84f8d95b-4552-419c-8d19-1af9fca6a1d3 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:58 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1221bf23-599f-4f91-9362-5f586a7a1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2144503b-0777-4489-a6dc-1097f323913d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88417db-1607-4c7c-821d-00ed5bc9514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:58 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 1073741824 Apr 01 08:09:58 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Volume volume-2144503b-0777-4489-a6dc-1097f323913d (2144503b-0777-4489-a6dc-1097f323913d): created successfully Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88417db-1607-4c7c-821d-00ed5bc9514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:58 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (e0138526-fef0-43aa-9c9d-5165d344dd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:58 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-804a1b1f-d168-43a1-aec1-ca772a6bc498 tempest-CreateVolumesFromImageTest-971570540 None] Created volume successfully. Apr 01 08:09:58 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.398s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:09:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b84e006c-3871-447f-8756-827f76b521f1 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-464a5f4f-a9f4-4482-8138-8c8a2c80e6cf-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:09:58 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 1073741824" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:58 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 Apr 01 08:09:58 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-270d3cf6-570d-4f49-b452-e1ce00e88363-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-270d3cf6-570d-4f49-b452-e1ce00e88363-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-270d3cf6-570d-4f49-b452-e1ce00e88363" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-270d3cf6-570d-4f49-b452-e1ce00e88363" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20744fb-251d-42bb-9dec-4d9ab529b292]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:59 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3" returned: 0 in 0.422s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-867639609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb926c5-7de5-41da-bb2b-c439dbd7a4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Creating volume 0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:09:59 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1695c06-90dd-41f1-abae-96152aca2569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:59 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 1073741824 Apr 01 08:09:59 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a800252-7fa0-4ca9-b0e1-c06c2a1b7a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:09:59 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Volume volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 (84f8d95b-4552-419c-8d19-1af9fca6a1d3): created successfully Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a800252-7fa0-4ca9-b0e1-c06c2a1b7a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:09:59 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 Apr 01 08:09:59 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Flow 'volume_create_manager' (4c7c088b-5841-40af-a179-46c15cf52193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:09:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2e261799-e55c-4ba7-94af-dd2b05ebf607 tempest-GroupsTest-1769182392 None] Created volume successfully. Apr 01 08:09:59 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:59 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363 Apr 01 08:09:59 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:09:59 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 1073741824" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:09:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:09:59 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 Apr 01 08:09:59 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:00 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-270d3cf6-570d-4f49-b452-e1ce00e88363" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-270d3cf6-570d-4f49-b452-e1ce00e88363" released by "delete_volume" :: held 0.895s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['e794d46e-d9b4-45d9-a60b-c77ac3102977', '7bfc9946-b3f2-4254-972c-29afecb33039', 'c84513b6-0126-491b-9bc0-8cb90cc489b1', '13d00178-343d-428c-9bda-28d58637f06a'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:00 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" returned: 0 in 0.411s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1595921946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094517e1-1989-4a60-9502-5b4e15a0b2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:57Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Creating volume 094517e1-1989-4a60-9502-5b4e15a0b2c6 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:00 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f344fc45-8edc-4c3d-83d4-be9384e5b3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b38d82-0de5-43a1-95cc-40d7518a5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:00 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 1073741824 Apr 01 08:10:00 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:00 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Volume volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 (0cb926c5-7de5-41da-bb2b-c439dbd7a4a8): created successfully Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b38d82-0de5-43a1-95cc-40d7518a5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (65f7a2e4-ea03-4ba0-a6ba-9e7d29d7aa12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-aaf80de4-7776-4305-bce5-1489839ddad2 tempest-CreateVolumesFromImageTest-971570540 None] Created volume successfully. Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:00 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:00 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[885fb6c3-4fb3-40bd-8073-ea8dc79bcd47]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b355e281-22dd-47f0-9df8-ab337a7f64d3 tempest-GroupsTest-1769182392 None] Update group completed successfully. Apr 01 08:10:00 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 Apr 01 08:10:00 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:00 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 1073741824" returned: 0 in 0.536s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:00 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b599fb29-c135-48a4-ad26-ed9afb234636 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-270d3cf6-570d-4f49-b452-e1ce00e88363-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:00 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 Apr 01 08:10:00 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:00 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" returned: 0 in 0.513s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:00 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0 Apr 01 08:10:00 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:01 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6" returned: 0 in 0.414s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.373s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769788357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5121064-cfa4-414a-b93a-b56b88c82f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:58Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Creating volume c5121064-cfa4-414a-b93a-b56b88c82f79 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:01 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef117a3-7e3c-4d7a-aa17-265f98306832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094517e1-1989-4a60-9502-5b4e15a0b2c6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:01 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 1073741824 Apr 01 08:10:01 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c6c68-c817-4c73-81cd-833e979590e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:01 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Volume volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 (094517e1-1989-4a60-9502-5b4e15a0b2c6): created successfully Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c6c68-c817-4c73-81cd-833e979590e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (2f92888c-4a87-4bc1-836a-30e9d18fb61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-012ee8e2-6651-4ef0-a064-5c470aed1293 tempest-CreateVolumesFromImageTest-971570540 None] Created volume successfully. Apr 01 08:10:01 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0" released by "delete_volume" :: held 0.938s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['47bfa172-182f-4422-8dee-c369b3c1a2ca', '7cbdde63-f20f-4bd9-aa17-455210a5e51b', '74be64cb-cb87-4a7a-bfb7-d4ae61e51e97', '73198bd6-3da6-4170-95bb-d2db1bd22461'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:01 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:01 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-f9a57344-b686-4bfd-a30f-b34443a9f2db-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-f9a57344-b686-4bfd-a30f-b34443a9f2db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-f9a57344-b686-4bfd-a30f-b34443a9f2db" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-f9a57344-b686-4bfd-a30f-b34443a9f2db" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[332662c9-b511-4114-b8b6-c70b6098c9d6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:01 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db Apr 01 08:10:01 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:01 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 1073741824" returned: 0 in 0.542s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:01 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 Apr 01 08:10:01 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-17ccbccf-0e58-470b-9b73-be0b9b1f92eb tempest-GroupsTest-1769182392 None] Update group completed successfully. Apr 01 08:10:01 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.465s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:10:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5e029830-de5a-4b25-9e1d-7bbcbfaeaade tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-a048a4f4-7a48-4c50-80d0-c5be61e6c0c0-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:02 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db" returned: 0 in 0.478s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:02 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db Apr 01 08:10:02 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:02 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79" returned: 0 in 0.411s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.199s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-444771024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94155568-7312-4e53-84be-f1ad7aecde86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a96c7f59594ee88688b2bdc4c9b828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:09:58Z,use_quota=True,user_id='6fb8ea3f2f9c440784ccd55de3325066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Creating volume 94155568-7312-4e53-84be-f1ad7aecde86 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:02 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39dedf2-65d9-473e-ac94-e6fe769f4564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5121064-cfa4-414a-b93a-b56b88c82f79', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9689c4-3d73-437b-9497-5907287f8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:02 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 1073741824 Apr 01 08:10:02 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:02 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Volume volume-c5121064-cfa4-414a-b93a-b56b88c82f79 (c5121064-cfa4-414a-b93a-b56b88c82f79): created successfully Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9689c4-3d73-437b-9497-5907287f8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (b3901abf-d491-4a57-badd-d2433c474b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6eeffe87-23e5-4575-b193-51fb1d784ba4 tempest-CreateVolumesFromImageTest-971570540 None] Created volume successfully. Apr 01 08:10:02 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f9a57344-b686-4bfd-a30f-b34443a9f2db" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-f9a57344-b686-4bfd-a30f-b34443a9f2db" released by "delete_volume" :: held 0.885s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['185626c9-7491-4b63-95de-547c7dba6a45', '26c3d8df-c8f3-470b-882d-f4c2d4d6a6a6', '4ddbdbda-7269-419f-94c7-624c7fd8a5a4', 'f27303d8-d61e-4d46-ba06-dfdaf7ebf855'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:02 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:02 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-eb928218-1361-4ce1-a0e7-31a159e867b5-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-eb928218-1361-4ce1-a0e7-31a159e867b5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:02 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 1073741824" returned: 0 in 0.489s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "cinder-quobyte-eb928218-1361-4ce1-a0e7-31a159e867b5" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-eb928218-1361-4ce1-a0e7-31a159e867b5" acquired by "delete_volume" :: waited 0.019s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:02 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 Apr 01 08:10:02 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f34d7-82b8-4487-abf7-dd38c19254a0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:02 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 Apr 01 08:10:02 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:03 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fcffd102-23c6-42b0-8d49-8b1efdbc7171 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-f9a57344-b686-4bfd-a30f-b34443a9f2db-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Acquiring lock "cinder-quobyte-84f8d95b-4552-419c-8d19-1af9fca6a1d3" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-84f8d95b-4552-419c-8d19-1af9fca6a1d3" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0258c-57c8-4ccd-85e4-6f96ee632fca]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 Apr 01 08:10:03 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86" returned: 0 in 0.462s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48d6dbb-ac45-4665-a6cb-b32f58c415d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94155568-7312-4e53-84be-f1ad7aecde86', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c24ae-9445-4240-b8e7-2a454072dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:03 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Volume volume-94155568-7312-4e53-84be-f1ad7aecde86 (94155568-7312-4e53-84be-f1ad7aecde86): created successfully Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c24ae-9445-4240-b8e7-2a454072dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Flow 'volume_create_manager' (2ab3f288-bf2c-40a8-b1d8-fee66ae20a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:03 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4ef1f118-6a31-4024-a1ff-69d1e9a4b212 tempest-CreateVolumesFromImageTest-971570540 None] Created volume successfully. Apr 01 08:10:03 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5" returned: 0 in 0.501s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5 Apr 01 08:10:03 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-94155568-7312-4e53-84be-f1ad7aecde86-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-94155568-7312-4e53-84be-f1ad7aecde86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=194,cinder:SELECT=142,cinder:INSERT=42,cinder:DELETE=16 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-quobyte-94155568-7312-4e53-84be-f1ad7aecde86" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-94155568-7312-4e53-84be-f1ad7aecde86" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de519aa-64fd-4279-9bf2-abdbf3ae4e45]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 Apr 01 08:10:03 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3" returned: 0 in 0.477s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3 Apr 01 08:10:03 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eb928218-1361-4ce1-a0e7-31a159e867b5" returned: 0 in 0.394s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-quobyte-eb928218-1361-4ce1-a0e7-31a159e867b5" released by "delete_volume" :: held 0.918s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Created reservations ['c2266363-a7b5-4f5f-9ded-a24063f93a83', '73f5e61d-80ea-475a-becb-64e53eb40a5d', '473cbfac-36aa-4429-915a-330a27936ea2', 'ba0eebb1-7150-4d4a-96c7-ea5d5f66181c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:03 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:03 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86" returned: 0 in 0.517s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:03 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86 Apr 01 08:10:03 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:04 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-84f8d95b-4552-419c-8d19-1af9fca6a1d3" returned: 0 in 0.437s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-84f8d95b-4552-419c-8d19-1af9fca6a1d3" released by "delete_volume" :: held 0.936s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Acquiring lock "cinder-quobyte-921dc6f1-1183-43d5-bfec-79678f943947" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-921dc6f1-1183-43d5-bfec-79678f943947" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80690e-e81e-4190-816f-e41d935fb94c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:04 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 Apr 01 08:10:04 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:04 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Deleted volume successfully. Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b9ba86c5-a6f2-4894-b2e9-e1343cd0a270 tempest-CreateVolumesFromSourceVolumeTest-531580176 None] Lock "cinder-eb928218-1361-4ce1-a0e7-31a159e867b5-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:04 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-94155568-7312-4e53-84be-f1ad7aecde86" returned: 0 in 0.505s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-94155568-7312-4e53-84be-f1ad7aecde86" released by "delete_volume" :: held 1.045s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Created reservations ['1cabb774-4d5b-4c16-933c-4e4c700e561f', '1c1988c0-9b46-48ed-993f-832989e5f2e4', '7310bd0f-37e3-4c68-8cf4-1e7f92291660', 'a0768444-f033-404c-a63b-6cf753651d92'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:04 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:04 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:04 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947" returned: 0 in 0.539s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:04 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947 Apr 01 08:10:04 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:04 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Deleted volume successfully. Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7b0f21a1-ca80-4d12-bdc2-2a91ef8d7a7f tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-94155568-7312-4e53-84be-f1ad7aecde86-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:05 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-921dc6f1-1183-43d5-bfec-79678f943947" returned: 0 in 0.451s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "cinder-quobyte-921dc6f1-1183-43d5-bfec-79678f943947" released by "delete_volume" :: held 1.019s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Created reservations ['38a38610-8d0d-451b-b088-2aeda97837ed'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:05 devstack cinder-volume[82084]: WARNING cinder.quota [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1477400095 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1477400095, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:10:05 devstack cinder-volume[82084]: WARNING cinder.quota [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1477400095 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1477400095, it is now deprecated. Please use the default quota class for default quota. Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Created reservations ['4007deb7-b48b-4fc7-b562-5c5a380f0a9c', 'c29314e9-d76f-492d-94e3-fe908bcea454', '2e5354ac-0bdc-464f-a914-7ebdf9195801', '729c08c5-0989-44cf-ac2c-0d72006c5c75'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Created reservations ['d0225487-a5e2-414c-b3d5-c22c8def2b23', '199b1fac-1470-483b-b1c0-edef08cb5516', '601c7a66-8214-4875-90e3-bf7dc1be2dcf', '9590ae23-dee7-4d3e-a4dc-739bcbf5a8a3'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:05 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:05 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-c5121064-cfa4-414a-b93a-b56b88c82f79-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-c5121064-cfa4-414a-b93a-b56b88c82f79-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-quobyte-c5121064-cfa4-414a-b93a-b56b88c82f79" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-c5121064-cfa4-414a-b93a-b56b88c82f79" acquired by "delete_volume" :: waited 0.017s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b1663-4869-42a5-8f52-de4419ce17e1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:05 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 Apr 01 08:10:05 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:05 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:05 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9aca232d-2936-47b9-9fa2-4aef3074e27c tempest-GroupsTest-1769182392 None] Delete group completed successfully. Apr 01 08:10:06 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79" returned: 0 in 0.620s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:06 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79 Apr 01 08:10:06 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:06 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c5121064-cfa4-414a-b93a-b56b88c82f79" returned: 0 in 0.481s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-c5121064-cfa4-414a-b93a-b56b88c82f79" released by "delete_volume" :: held 1.125s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Created reservations ['1e4a99f0-fd2d-44f5-9b08-07e322db8cb3', '429e1125-5f76-4172-add7-bb10c6908b34', '95d8e047-dc89-4f91-b5cb-58faa8551177', '8a39801d-2c40-4084-9b15-6b300f647a69'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:06 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:06 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:07 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:07 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Deleted volume successfully. Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-77296e5f-6efa-4dcc-96e5-2c9ec8833145 tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-c5121064-cfa4-414a-b93a-b56b88c82f79-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-094517e1-1989-4a60-9502-5b4e15a0b2c6-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-094517e1-1989-4a60-9502-5b4e15a0b2c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-quobyte-094517e1-1989-4a60-9502-5b4e15a0b2c6" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-094517e1-1989-4a60-9502-5b4e15a0b2c6" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd813d3d-bebb-46e1-b56d-7227f1d26b8d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:07 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 Apr 01 08:10:07 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:08 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:08 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6 Apr 01 08:10:08 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:08 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-094517e1-1989-4a60-9502-5b4e15a0b2c6" returned: 0 in 0.548s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-094517e1-1989-4a60-9502-5b4e15a0b2c6" released by "delete_volume" :: held 1.097s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:08 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Created reservations ['c4c4515b-e1db-47aa-b5ba-8e81b2425ee0', '01dd6519-2643-4a00-a58b-f57f91ebd455', '8b7dcd8e-e092-43bd-a414-e8dbbe8db013', 'f2849b9e-f9d8-4e06-9c8f-c62a6e420c26'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:09 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:09 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:09 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.486s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:09 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Deleted volume successfully. Apr 01 08:10:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-babcecd0-871e-48cf-8838-75ef0091dd2a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-094517e1-1989-4a60-9502-5b4e15a0b2c6-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-quobyte-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2910da-9ce0-46a2-938e-83efdae1dc10]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:10 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 Apr 01 08:10:10 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:10 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" returned: 0 in 0.670s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:10 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8 Apr 01 08:10:10 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:11 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" returned: 0 in 0.514s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8" released by "delete_volume" :: held 1.211s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Created reservations ['03c0b46d-1374-4e39-b718-8428db933f25', '95167ec2-c2a9-4b00-b02e-d0e51df4e599', '0a2408e3-9c02-4747-b687-b3a675781261', '56f06cca-86a9-433e-b6f9-54035b228a57'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:11 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:11 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:11 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Deleted volume successfully. Apr 01 08:10:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-06c9c41e-766f-4d03-aec4-92f15795afee tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-0cb926c5-7de5-41da-bb2b-c439dbd7a4a8-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-2144503b-0777-4489-a6dc-1097f323913d-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-2144503b-0777-4489-a6dc-1097f323913d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "cinder-quobyte-2144503b-0777-4489-a6dc-1097f323913d" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-2144503b-0777-4489-a6dc-1097f323913d" acquired by "delete_volume" :: waited 0.029s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d64d7-8ab6-499f-861a-044be5c2c585]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:12 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d Apr 01 08:10:12 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:12 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d" returned: 0 in 0.547s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:12 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d Apr 01 08:10:12 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:13 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-2144503b-0777-4489-a6dc-1097f323913d" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-quobyte-2144503b-0777-4489-a6dc-1097f323913d" released by "delete_volume" :: held 1.052s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Created reservations ['9ee6b7c5-57cf-4da9-8179-3ee73b2e1076', '5bb5afa4-8bae-48c7-b35f-10cd76968534', 'bfde79fb-c321-4e9e-8369-b599a69ead9b', '17433eac-32bd-44eb-bc37-f1d8d8976012'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:13 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:13 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:14 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:14 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Deleted volume successfully. Apr 01 08:10:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5540d3-7b43-4ad6-b585-177f4848289a tempest-CreateVolumesFromImageTest-971570540 None] Lock "cinder-2144503b-0777-4489-a6dc-1097f323913d-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Flow 'volume_create_manager' (fe4cb50d-7a1d-42be-b1e2-7b1970573285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c494c1d3-6249-4ddb-88fd-3ad15226e60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c494c1d3-6249-4ddb-88fd-3ad15226e60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1635348682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3b1557-0b65-4387-bfa6-dae389fe77d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd12e8d337bd46819fd8180a762dcc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:16Z,use_quota=True,user_id='63ee7d60026e4abc8686bcec7f72f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236cc127-90e3-436f-aff2-d3d2f8a304c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236cc127-90e3-436f-aff2-d3d2f8a304c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1928789a-5866-4540-a00c-4dc52898e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1928789a-5866-4540-a00c-4dc52898e841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3b1557-0b65-4387-bfa6-dae389fe77d6', 'volume_name': 'volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f47e34f-eff2-4b02-b0a5-a1331c4414a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f47e34f-eff2-4b02-b0a5-a1331c4414a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c9163-9a3f-4b36-8eab-9f0d26c94850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Volume 4e3b1557-0b65-4387-bfa6-dae389fe77d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6', 'volume_size': 1} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1635348682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3b1557-0b65-4387-bfa6-dae389fe77d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd12e8d337bd46819fd8180a762dcc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:16Z,use_quota=True,user_id='63ee7d60026e4abc8686bcec7f72f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Creating volume 4e3b1557-0b65-4387-bfa6-dae389fe77d6 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:16 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:16 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 1073741824 Apr 01 08:10:16 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:16 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 1073741824" returned: 0 in 0.612s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:16 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 Apr 01 08:10:16 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:17 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c9163-9a3f-4b36-8eab-9f0d26c94850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec7f71d-2416-49f2-b3d2-f11e9342bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Volume volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 (4e3b1557-0b65-4387-bfa6-dae389fe77d6): created successfully Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec7f71d-2416-49f2-b3d2-f11e9342bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Flow 'volume_create_manager' (fe4cb50d-7a1d-42be-b1e2-7b1970573285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:17 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-118745bb-c1d5-42b9-be4a-980a0e2afa21 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Created volume successfully. Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Flow 'volume_create_manager' (d22b63d7-3aa7-4c3d-aae2-36f1a8d0fd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506ca80-14b0-4e15-910d-cf663f67b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506ca80-14b0-4e15-910d-cf663f67b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-435705776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eeb7d39b5854ee5aa47d7cf55803b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:18Z,use_quota=True,user_id='98178472fccb4009b761aaa0471c5fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcfc675-47c7-4d76-bd0c-a910a29d9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcfc675-47c7-4d76-bd0c-a910a29d9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e73331f-3cd1-47dc-8187-316024f405d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e73331f-3cd1-47dc-8187-316024f405d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97', 'volume_name': 'volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d8aee9-be04-4a81-96aa-5d99b186796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d8aee9-be04-4a81-96aa-5d99b186796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b774e-778f-4a55-9d90-48fe2666579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:18 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Volume d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97', 'volume_size': 1} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-435705776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eeb7d39b5854ee5aa47d7cf55803b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:18Z,use_quota=True,user_id='98178472fccb4009b761aaa0471c5fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Creating volume d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:18 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:18 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 1073741824 Apr 01 08:10:18 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Acquiring lock "cinder-4e3b1557-0b65-4387-bfa6-dae389fe77d6-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "cinder-4e3b1557-0b65-4387-bfa6-dae389fe77d6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Acquiring lock "cinder-quobyte-4e3b1557-0b65-4387-bfa6-dae389fe77d6" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "cinder-quobyte-4e3b1557-0b65-4387-bfa6-dae389fe77d6" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ea030-7273-4360-90eb-1b6126e12be0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:18 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 Apr 01 08:10:18 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:18 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 1073741824" returned: 0 in 0.554s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:19 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:19 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:19 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6" returned: 0 in 0.523s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:19 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6 Apr 01 08:10:19 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:19 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b774e-778f-4a55-9d90-48fe2666579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98076a69-cb6c-4819-8e62-02526a178f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Volume volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 (d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97): created successfully Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98076a69-cb6c-4819-8e62-02526a178f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Flow 'volume_create_manager' (d22b63d7-3aa7-4c3d-aae2-36f1a8d0fd4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-bde7b0d5-8bbf-401b-a794-26692ce82805 tempest-SnapshotDependencyTests-1954506633 None] Created volume successfully. Apr 01 08:10:19 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-4e3b1557-0b65-4387-bfa6-dae389fe77d6" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "cinder-quobyte-4e3b1557-0b65-4387-bfa6-dae389fe77d6" released by "delete_volume" :: held 0.973s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Created reservations ['7dcd95e2-9934-479e-b7d4-36617abb4e49', '32720a4b-9c25-4613-816e-f39ce031aba1', '3700ead9-a5b4-4ffc-8631-f61cf108bd63', '953bad70-5364-4c79-bca5-e85f8c4c22b1'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:19 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:19 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:20 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.448s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Deleted volume successfully. Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-b73e2ae2-e99f-46a6-b2a6-03a29abaec12 tempest-VolumeQuotasNegativeTestJSON-890486128 None] Lock "cinder-4e3b1557-0b65-4387-bfa6-dae389fe77d6-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Creating offline snapshot 08859bbe-6092-48f3-bdaf-6f0b08589560 of volume d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0820b-8057-4748-b6dd-a638772662b0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:20 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:20 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:21 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.502s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:21 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 1G Apr 01 08:10:21 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:21 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 1G" returned: 0 in 0.524s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:21 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:21 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:22 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.481s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:22 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 is being set with open permissions: ugo+rw Apr 01 08:10:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:22 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:22 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:22 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:22 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info Apr 01 08:10:22 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:23 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info" returned: 0 in 0.501s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:23 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info is being set with open permissions: ugo+rw Apr 01 08:10:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:23 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info Apr 01 08:10:23 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:23 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.info" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0c765032-077e-405e-810b-b36bbb5f869a tempest-SnapshotDependencyTests-1954506633 None] Create snapshot completed successfully Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=157,cinder:INSERT=38,cinder:UPDATE=209,cinder:DELETE=14 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Flow 'volume_create_manager' (0ba906db-7bb8-4d53-a6c6-7dd0e2424dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0504c09c-3146-4186-83a4-6fb9f2bda90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0504c09c-3146-4186-83a4-6fb9f2bda90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c7210a-b190-4643-b04c-5edf9d2e4586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eeb7d39b5854ee5aa47d7cf55803b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08859bbe-6092-48f3-bdaf-6f0b08589560,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:24Z,use_quota=True,user_id='98178472fccb4009b761aaa0471c5fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce27466c-c308-4dfc-a153-623c1364ccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce27466c-c308-4dfc-a153-623c1364ccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c06f59e-468f-44ea-8ae3-2b5e59e7420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c06f59e-468f-44ea-8ae3-2b5e59e7420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5c7210a-b190-4643-b04c-5edf9d2e4586', 'volume_name': 'volume-a5c7210a-b190-4643-b04c-5edf9d2e4586', 'volume_size': 1, 'snapshot_id': '08859bbe-6092-48f3-bdaf-6f0b08589560'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb58c19-35de-45e9-abaf-011f14774e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb58c19-35de-45e9-abaf-011f14774e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9d86f9-219e-4465-abd4-267422436063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:24 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Volume a5c7210a-b190-4643-b04c-5edf9d2e4586: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5c7210a-b190-4643-b04c-5edf9d2e4586', 'volume_size': 1, 'snapshot_id': '08859bbe-6092-48f3-bdaf-6f0b08589560'} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560-a5c7210a-b190-4643-b04c-5edf9d2e4586" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560-a5c7210a-b190-4643-b04c-5edf9d2e4586" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Creating volume a5c7210a-b190-4643-b04c-5edf9d2e4586 from snapshot 08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] snapshot: 08859bbe-6092-48f3-bdaf-6f0b08589560, volume: a5c7210a-b190-4643-b04c-5edf9d2e4586, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4774f1-a25e-4066-bb1b-5105eb564e92]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:24 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:24 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:24 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b058d4-28cc-4b83-8188-f714b5f2cce1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:24 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:24 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:25 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.566s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:25 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:10:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:25 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 Apr 01 08:10:25 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:27 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586" returned: 0 in 2.271s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:27 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d576669-0105-4ac3-9e4f-f8571c0b04a0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:27 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:27 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:28 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.600s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:10:28 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Converted 1024.00 MB image at 450.52 MB/s Apr 01 08:10:28 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 is being set with open permissions: ugo+rw Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:28 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 Apr 01 08:10:28 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:28 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" released by "_copy_volume_from_snapshot" :: held 4.438s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560-a5c7210a-b190-4643-b04c-5edf9d2e4586" released by "_create_volume_from_snapshot" :: held 4.457s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.474s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9d86f9-219e-4465-abd4-267422436063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c7210a-b190-4643-b04c-5edf9d2e4586', 'volume_size': 1, 'snapshot_id': '08859bbe-6092-48f3-bdaf-6f0b08589560'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d62b790-57c8-42b0-b105-28b582363810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:28 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Volume volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 (a5c7210a-b190-4643-b04c-5edf9d2e4586): created successfully Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d62b790-57c8-42b0-b105-28b582363810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Flow 'volume_create_manager' (0ba906db-7bb8-4d53-a6c6-7dd0e2424dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:28 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f5d2edfc-c578-46b3-aef8-6a9369d4960d tempest-SnapshotDependencyTests-1954506633 None] Created volume successfully. Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-08859bbe-6092-48f3-bdaf-6f0b08589560-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-08859bbe-6092-48f3-bdaf-6f0b08589560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Deleting offline snapshot 08859bbe-6092-48f3-bdaf-6f0b08589560 of volume d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] snapshot_file for this snap is: volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[53176d66-c3a9-4dd5-96e1-a7660b3eb3a4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:29 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:29 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:30 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.467s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c02c8-a583-4bf9-b140-ec2462936142]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:30 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:30 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:30 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:30 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:30 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:31 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.498s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:31 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560 Apr 01 08:10:31 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:31 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97.08859bbe-6092-48f3-bdaf-6f0b08589560" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-08859bbe-6092-48f3-bdaf-6f0b08589560" released by "_delete_snapshot" :: held 1.940s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" released by "delete_snapshot" :: held 1.955s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Created reservations ['66b48f4b-5fab-41e2-8fc8-8c28b68a6622', 'f48bcdf9-24e8-453c-ae12-53c40e589c46', 'cc6a7f97-e692-49da-8834-fa64a1019b3c', '1d1683e9-7831-499b-a3e9-8e4834c319f9'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:31 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Delete snapshot completed successfully. Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45dc19f7-ae0f-4eea-9ff3-d4ba7805ea4b tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-08859bbe-6092-48f3-bdaf-6f0b08589560-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac562b5-80ee-4612-943d-46b60da0a909]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:31 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:31 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:32 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:32 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97 Apr 01 08:10:32 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:32 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97" released by "delete_volume" :: held 0.988s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Created reservations ['c45cde1a-8ec6-49cb-9c8d-b62c91255dcf', '485ea158-9b33-48a9-af1d-04acf2737e59', 'bffe350f-67f0-4cb5-a46f-9c23ffa1c847', 'a3a9db5b-ad22-413a-bd1f-dd86bab1eb05'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:32 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:32 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:33 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:33 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Deleted volume successfully. Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a6e3cfde-0c71-4b68-878d-f02d9390875a tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-d03cf2e2-e015-4cf8-91f8-7dcbe6ce1d97-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-a5c7210a-b190-4643-b04c-5edf9d2e4586-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-a5c7210a-b190-4643-b04c-5edf9d2e4586-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6267f5-4edf-485a-8d7a-d48e3653958a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:34 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 Apr 01 08:10:34 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:34 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586" returned: 0 in 0.556s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:34 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586 Apr 01 08:10:34 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:34 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a5c7210a-b190-4643-b04c-5edf9d2e4586" returned: 0 in 0.467s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-quobyte-a5c7210a-b190-4643-b04c-5edf9d2e4586" released by "delete_volume" :: held 1.060s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Created reservations ['fa9fb17b-4901-4815-8eeb-d8bf4f6f00e8', '3652a1eb-e138-44f9-b3bc-d1d30565d7f4', 'fe96f33c-5036-48c0-8c0e-70121bf72d4d', 'fb61f940-6433-4096-8bec-9f092fd7275c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:35 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:35 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:35 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Deleted volume successfully. Apr 01 08:10:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9bd4ac38-3e71-4ff1-883f-9e231f5ee31c tempest-SnapshotDependencyTests-1954506633 None] Lock "cinder-a5c7210a-b190-4643-b04c-5edf9d2e4586-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:45 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=16,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:10:45 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=71,cinder:INSERT=33,cinder:UPDATE=88,cinder:DELETE=6 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:55 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:10:55 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (b8ac4b97-2bc5-4911-89aa-31612335c555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea448ab-efd3-4f68-b6bc-6f91227b3cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea448ab-efd3-4f68-b6bc-6f91227b3cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847316515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e240cbe-a278-4be9-bf7b-18fc484ee56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:56Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb60f311-9256-4ad6-a3d7-d696322e29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb60f311-9256-4ad6-a3d7-d696322e29d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72372791-1b95-4440-b0a7-56375be684c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72372791-1b95-4440-b0a7-56375be684c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e240cbe-a278-4be9-bf7b-18fc484ee56b', 'volume_name': 'volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a914a634-e5b5-4bf6-b67d-f6a0fc29609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a914a634-e5b5-4bf6-b67d-f6a0fc29609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdc59c-59ff-405d-ad80-98b20cb8e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Volume 3e240cbe-a278-4be9-bf7b-18fc484ee56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b', 'volume_size': 1} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847316515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e240cbe-a278-4be9-bf7b-18fc484ee56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:10:56Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Creating volume 3e240cbe-a278-4be9-bf7b-18fc484ee56b {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:10:56 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:56 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b 1073741824 Apr 01 08:10:56 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:56 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:10:56 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b 1073741824" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:10:56 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b Apr 01 08:10:56 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:10:57 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fdc59c-59ff-405d-ad80-98b20cb8e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3cec15-5bf8-405f-849a-11720ba3e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:10:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Volume volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b (3e240cbe-a278-4be9-bf7b-18fc484ee56b): created successfully Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3cec15-5bf8-405f-849a-11720ba3e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (b8ac4b97-2bc5-4911-89aa-31612335c555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:10:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a0f29b4b-8505-4b7a-8541-224d1d0ea436 tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-877cf582-e2bf-4314-9999-1acabdd35ed2 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b" by "attach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-877cf582-e2bf-4314-9999-1acabdd35ed2 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b" acquired by "attach_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-877cf582-e2bf-4314-9999-1acabdd35ed2 tempest-VolumesActionsTest-1843079629 None] Attaching volume 3e240cbe-a278-4be9-bf7b-18fc484ee56b to instance 13c138b7-7dcb-406f-94f4-6c41b320b632 at mountpoint /dev/vdb on host None. Apr 01 08:10:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-877cf582-e2bf-4314-9999-1acabdd35ed2 tempest-VolumesActionsTest-1843079629 None] Attach volume completed successfully. Apr 01 08:10:57 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-877cf582-e2bf-4314-9999-1acabdd35ed2 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b" released by "attach_volume" :: held 0.053s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Terminate volume connection completed successfully. Apr 01 08:10:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" by "detach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Detaching volume 3e240cbe-a278-4be9-bf7b-18fc484ee56b from instance 13c138b7-7dcb-406f-94f4-6c41b320b632. Apr 01 08:10:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Detach volume completed successfully. Apr 01 08:10:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-796cb3c0-469f-4850-a382-3116f0aed745 tempest-VolumesActionsTest-981908737 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fd952fec-7478-4c56-97fc-b8357f1649c3 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" by "detach_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fd952fec-7478-4c56-97fc-b8357f1649c3 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fd952fec-7478-4c56-97fc-b8357f1649c3 tempest-VolumesActionsTest-1843079629 None] Volume detach called, but volume not attached. Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fd952fec-7478-4c56-97fc-b8357f1649c3 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-detach_volume" released by "detach_volume" :: held 0.008s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-quobyte-3e240cbe-a278-4be9-bf7b-18fc484ee56b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-quobyte-3e240cbe-a278-4be9-bf7b-18fc484ee56b" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[658c9e35-8bcd-4367-897e-e8850e2f8eb5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:10:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:00 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b Apr 01 08:11:00 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:00 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b" returned: 0 in 0.461s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:00 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b Apr 01 08:11:00 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:00 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-3e240cbe-a278-4be9-bf7b-18fc484ee56b" returned: 0 in 0.401s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-quobyte-3e240cbe-a278-4be9-bf7b-18fc484ee56b" released by "delete_volume" :: held 0.894s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Created reservations ['67edbb69-5ae8-4695-8538-29bb5eb57013', '253fc622-fa5b-4595-9e43-df63477d5b2b', '1af1f35b-e510-4e96-af1e-fa7699abe264', '70a04f9c-8146-48b3-9e04-63f0fad03b2b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:00 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:00 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:01 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:01 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Deleted volume successfully. Apr 01 08:11:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e3dc4bd1-057a-4cd3-b473-e37296cca9e7 tempest-VolumesActionsTest-1843079629 None] Lock "cinder-3e240cbe-a278-4be9-bf7b-18fc484ee56b-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (4241be36-1f7f-4599-aa0e-29064e9d011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b20b41-4f00-426d-9b1c-2fc137b220e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b20b41-4f00-426d-9b1c-2fc137b220e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958083236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c279a362-ce0c-4afb-99b6-03ffacd014cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:08Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3807dd83-9808-426f-a4a7-e422458618db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3807dd83-9808-426f-a4a7-e422458618db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde1884-fe28-402a-8f46-e59e1bddf3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde1884-fe28-402a-8f46-e59e1bddf3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c279a362-ce0c-4afb-99b6-03ffacd014cb', 'volume_name': 'volume-c279a362-ce0c-4afb-99b6-03ffacd014cb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f1cb03-3fb2-4a7c-b6df-51c9b5cdcef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f1cb03-3fb2-4a7c-b6df-51c9b5cdcef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8bd8c0-a929-4e9e-a4cc-07638ae706e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:08 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Volume c279a362-ce0c-4afb-99b6-03ffacd014cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c279a362-ce0c-4afb-99b6-03ffacd014cb', 'volume_size': 1} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958083236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c279a362-ce0c-4afb-99b6-03ffacd014cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:08Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Creating volume c279a362-ce0c-4afb-99b6-03ffacd014cb {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:08 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:08 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb 1073741824 Apr 01 08:11:08 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:08 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb 1073741824" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:08 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb Apr 01 08:11:08 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:09 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8bd8c0-a929-4e9e-a4cc-07638ae706e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c279a362-ce0c-4afb-99b6-03ffacd014cb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8778f16d-1e11-4f1c-bdf9-969d40a6b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:09 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Volume volume-c279a362-ce0c-4afb-99b6-03ffacd014cb (c279a362-ce0c-4afb-99b6-03ffacd014cb): created successfully Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8778f16d-1e11-4f1c-bdf9-969d40a6b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (4241be36-1f7f-4599-aa0e-29064e9d011c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:09 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4f232323-2b54-4ed2-be8f-8a54e62abbcd tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-c279a362-ce0c-4afb-99b6-03ffacd014cb-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "cinder-c279a362-ce0c-4afb-99b6-03ffacd014cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-quobyte-c279a362-ce0c-4afb-99b6-03ffacd014cb" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-c279a362-ce0c-4afb-99b6-03ffacd014cb" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[47371b1e-c171-41b1-bb7f-c95cf65a316e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:09 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb Apr 01 08:11:09 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:09 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:09 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb Apr 01 08:11:09 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:10 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c279a362-ce0c-4afb-99b6-03ffacd014cb" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-c279a362-ce0c-4afb-99b6-03ffacd014cb" released by "delete_volume" :: held 0.837s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Created reservations ['13522d3a-4d13-4a17-8275-56931f45a378', '0eb1c758-d252-42d6-b48c-b6c70db867ae', '360a13d9-96f3-4660-a096-35951252b48e', '52b5f28c-7229-49ae-b7e7-10b3a18ca231'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:10 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:10 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:10 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.407s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Deleted volume successfully. Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-5c11c315-703c-48c6-9d18-376298373dc6 tempest-VolumesActionsTest-981908737 None] Lock "cinder-c279a362-ce0c-4afb-99b6-03ffacd014cb-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (b878d3aa-305e-4644-b59a-253383cf6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921554a-205a-4863-9ea6-25ab7c6be86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921554a-205a-4863-9ea6-25ab7c6be86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-139264665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a940c83b-1559-460f-be46-5d14cc0220f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:11Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46b931-8cfe-4525-b89e-c3cf31189716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46b931-8cfe-4525-b89e-c3cf31189716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e38081-c995-47d1-82bf-afc260db1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e38081-c995-47d1-82bf-afc260db1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a940c83b-1559-460f-be46-5d14cc0220f4', 'volume_name': 'volume-a940c83b-1559-460f-be46-5d14cc0220f4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430b03ad-c60a-4479-8326-f5b393ee97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430b03ad-c60a-4479-8326-f5b393ee97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345b980a-a6a4-4026-aa08-5b2b2d624a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:10 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Volume a940c83b-1559-460f-be46-5d14cc0220f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a940c83b-1559-460f-be46-5d14cc0220f4', 'volume_size': 1} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-139264665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a940c83b-1559-460f-be46-5d14cc0220f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:11Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Creating volume a940c83b-1559-460f-be46-5d14cc0220f4 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:10 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:10 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 1073741824 Apr 01 08:11:10 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:11 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 1073741824" returned: 0 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:11 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 Apr 01 08:11:11 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:11 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345b980a-a6a4-4026-aa08-5b2b2d624a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a940c83b-1559-460f-be46-5d14cc0220f4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67caf37d-b4c4-49d3-9123-c00ddfcbfbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:11 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Volume volume-a940c83b-1559-460f-be46-5d14cc0220f4 (a940c83b-1559-460f-be46-5d14cc0220f4): created successfully Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67caf37d-b4c4-49d3-9123-c00ddfcbfbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (b878d3aa-305e-4644-b59a-253383cf6e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b6500c65-fe80-4b75-9556-8ee4a25ff6b7 tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-a940c83b-1559-460f-be46-5d14cc0220f4-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "cinder-a940c83b-1559-460f-be46-5d14cc0220f4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-quobyte-a940c83b-1559-460f-be46-5d14cc0220f4" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-a940c83b-1559-460f-be46-5d14cc0220f4" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194fca8-9a6e-453c-be0f-8f501088bcd0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:12 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 Apr 01 08:11:12 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:12 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:12 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4 Apr 01 08:11:12 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:12 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a940c83b-1559-460f-be46-5d14cc0220f4" returned: 0 in 0.375s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-a940c83b-1559-460f-be46-5d14cc0220f4" released by "delete_volume" :: held 0.828s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Created reservations ['bb0c1e89-b852-4773-8dde-f4cd000b7abd', '0559a028-3fa3-4118-9f87-5190689c0654', 'f5336661-edec-4849-accd-b60e10261b20', '5910563a-3f70-4b4c-9acb-77e2bba56ffa'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:12 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:12 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:13 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.407s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Deleted volume successfully. Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8ee44405-fadc-415b-a95a-16b4aadb313b tempest-VolumesActionsTest-981908737 None] Lock "cinder-a940c83b-1559-460f-be46-5d14cc0220f4-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (88276a64-d48b-4707-9209-ae2017b5c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2271a2a2-78f0-4b68-8e08-4fd1de81ca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2271a2a2-78f0-4b68-8e08-4fd1de81ca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129879464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac52569-c292-427d-ad89-4ea0c107d30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:13Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c125feb5-36bb-43ee-b0d4-a0a96f61eea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c125feb5-36bb-43ee-b0d4-a0a96f61eea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846e96fe-b572-48ac-b039-b428d98cde76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846e96fe-b572-48ac-b039-b428d98cde76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac52569-c292-427d-ad89-4ea0c107d30d', 'volume_name': 'volume-eac52569-c292-427d-ad89-4ea0c107d30d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e93ee4-4a5a-402b-a47e-dbac258a8121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e93ee4-4a5a-402b-a47e-dbac258a8121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaece30-d4ff-48bf-aba8-bae84c3bcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Volume eac52569-c292-427d-ad89-4ea0c107d30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac52569-c292-427d-ad89-4ea0c107d30d', 'volume_size': 1} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129879464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac52569-c292-427d-ad89-4ea0c107d30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:13Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Creating volume eac52569-c292-427d-ad89-4ea0c107d30d {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:13 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:13 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d 1073741824 Apr 01 08:11:13 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:13 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d 1073741824" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:13 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d Apr 01 08:11:13 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:14 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d" returned: 0 in 0.379s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaece30-d4ff-48bf-aba8-bae84c3bcd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac52569-c292-427d-ad89-4ea0c107d30d', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6359f14a-97f1-4296-9af9-3436710c94e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Volume volume-eac52569-c292-427d-ad89-4ea0c107d30d (eac52569-c292-427d-ad89-4ea0c107d30d): created successfully Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6359f14a-97f1-4296-9af9-3436710c94e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (88276a64-d48b-4707-9209-ae2017b5c58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3cee8c72-4aeb-435b-96d8-d0789be3c7e5 tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-eac52569-c292-427d-ad89-4ea0c107d30d-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "cinder-eac52569-c292-427d-ad89-4ea0c107d30d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-quobyte-eac52569-c292-427d-ad89-4ea0c107d30d" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-eac52569-c292-427d-ad89-4ea0c107d30d" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7ccf1-90c7-480a-bc08-159aece45378]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:14 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d Apr 01 08:11:14 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:15 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:15 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d Apr 01 08:11:15 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:15 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-eac52569-c292-427d-ad89-4ea0c107d30d" returned: 0 in 0.375s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-eac52569-c292-427d-ad89-4ea0c107d30d" released by "delete_volume" :: held 0.832s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Created reservations ['0aa6f556-e67e-4bfa-b15c-652a5c9f9ec7', '5bd82fa1-bb5e-4adb-8d9c-41bb3d44c5bb', '14b576cd-1c7f-4ef5-bd7d-ec39c52c9706', '0020f97c-baf3-4a46-bfc4-89f0bd3680da'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:15 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:15 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:15 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.418s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Deleted volume successfully. Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (8b12f2fb-2134-4063-8d5d-fb2fd194f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607d1d38-41ee-4a6f-9dea-553c93f1e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607d1d38-41ee-4a6f-9dea-553c93f1e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604216647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146f604e-8e21-45e9-a280-d3b0a5cbad27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:16Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2e2db0-aa3b-4f2c-a07a-d69a70d85a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2e2db0-aa3b-4f2c-a07a-d69a70d85a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6bed52-d718-4a67-813f-2f4e663fdd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6bed52-d718-4a67-813f-2f4e663fdd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146f604e-8e21-45e9-a280-d3b0a5cbad27', 'volume_name': 'volume-146f604e-8e21-45e9-a280-d3b0a5cbad27', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539aa69b-91fb-4916-9dbb-aff543276e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539aa69b-91fb-4916-9dbb-aff543276e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a66728-094d-45e5-9223-8589e7d3b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Volume 146f604e-8e21-45e9-a280-d3b0a5cbad27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146f604e-8e21-45e9-a280-d3b0a5cbad27', 'volume_size': 1} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604216647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146f604e-8e21-45e9-a280-d3b0a5cbad27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:16Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Creating volume 146f604e-8e21-45e9-a280-d3b0a5cbad27 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:15 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-fc983ccf-7ee2-4b3e-a15b-0fc53432442a tempest-VolumesActionsTest-981908737 None] Lock "cinder-eac52569-c292-427d-ad89-4ea0c107d30d-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:15 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 1073741824 Apr 01 08:11:15 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:16 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 1073741824" returned: 0 in 0.452s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:16 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 Apr 01 08:11:16 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:16 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27" returned: 0 in 0.381s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a66728-094d-45e5-9223-8589e7d3b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146f604e-8e21-45e9-a280-d3b0a5cbad27', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edeae541-35b4-43ed-a762-d3f0ed62976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:16 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Volume volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 (146f604e-8e21-45e9-a280-d3b0a5cbad27): created successfully Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edeae541-35b4-43ed-a762-d3f0ed62976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (8b12f2fb-2134-4063-8d5d-fb2fd194f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:16 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-214e89e7-610c-4b4f-9d07-6d105362e9c0 tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-146f604e-8e21-45e9-a280-d3b0a5cbad27-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "cinder-146f604e-8e21-45e9-a280-d3b0a5cbad27-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Acquiring lock "cinder-quobyte-146f604e-8e21-45e9-a280-d3b0a5cbad27" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-146f604e-8e21-45e9-a280-d3b0a5cbad27" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f05f0-8892-4544-a49d-6c6a960e9577]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:18 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 Apr 01 08:11:18 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:18 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:18 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27 Apr 01 08:11:18 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:18 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-146f604e-8e21-45e9-a280-d3b0a5cbad27" returned: 0 in 0.374s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "cinder-quobyte-146f604e-8e21-45e9-a280-d3b0a5cbad27" released by "delete_volume" :: held 0.842s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Created reservations ['46d165e2-3e9c-45cb-8f22-d9a65470cdd8', '2b37c407-4c9a-4aa1-8e26-2d26429a8713', '5fbb605d-392f-4b73-a372-39cebad91d11', 'e01f8924-9da6-46c8-a299-d078745d7273'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:19 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:19 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (15b4d7ce-4d2b-43dd-938a-5a4a45fe3ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:19 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbdae78-3126-4159-803d-937d48c739a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.468s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbdae78-3126-4159-803d-937d48c739a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015158005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:19Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7287365-caad-4f0f-b00a-6cb61d4dce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7287365-caad-4f0f-b00a-6cb61d4dce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9a5c43-b9b6-41e3-81c1-85dd09f794dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9a5c43-b9b6-41e3-81c1-85dd09f794dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1', 'volume_name': 'volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400cf7b5-fdbc-4a35-9ad9-706fd8b5b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400cf7b5-fdbc-4a35-9ad9-706fd8b5b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25662f2-ec0f-426f-833f-5d6517ad7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Volume 89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1', 'volume_size': 1} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015158005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52834df199a64d32bbaf30e609c4ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:19Z,use_quota=True,user_id='05c38e69a7224178ba5fec847810b6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Creating volume 89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:19 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Deleted volume successfully. Apr 01 08:11:19 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 1073741824 Apr 01 08:11:19 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:19 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6c7ce7ba-5910-4dd5-8585-a2bb5070dfb7 tempest-VolumesActionsTest-981908737 None] Lock "cinder-146f604e-8e21-45e9-a280-d3b0a5cbad27-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:20 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 1073741824" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:20 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 Apr 01 08:11:20 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:20 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" returned: 0 in 0.389s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25662f2-ec0f-426f-833f-5d6517ad7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733ad61-4834-4ef0-99b8-7e22c3dc58b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Volume volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 (89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1): created successfully Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733ad61-4834-4ef0-99b8-7e22c3dc58b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Flow 'volume_create_manager' (15b4d7ce-4d2b-43dd-938a-5a4a45fe3ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a6fa85ba-8bbb-4aa1-ab3e-492616d876f2 tempest-VolumesActionsTest-1843079629 None] Created volume successfully. Apr 01 08:11:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "cinder-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Acquiring lock "cinder-quobyte-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "cinder-quobyte-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d491a573-9327-4752-aa42-0995e49350c0]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:21 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 Apr 01 08:11:21 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:21 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:21 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1 Apr 01 08:11:21 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:21 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" returned: 0 in 0.372s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "cinder-quobyte-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1" released by "delete_volume" :: held 0.837s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Created reservations ['14e00378-c599-4ef4-8009-10dda8b9525f', '19858c65-4241-4189-adca-1367a61a481b', '3dbd6579-ee22-411e-9e82-1438240ef96e', '69bcbc3a-f655-44b3-aae5-c645c04bfb0c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:21 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:21 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:22 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.382s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:22 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Deleted volume successfully. Apr 01 08:11:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d80b9f-4a82-490d-b2a8-9ec432abae4f tempest-VolumesActionsTest-1843079629 None] Lock "cinder-89e9a243-ba2c-4765-9cb3-4f12d3c2a4f1-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (ebceb4ab-7d80-47a2-a3b9-193c5870a2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d1222-df66-42dd-852c-0352d233c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d1222-df66-42dd-852c-0352d233c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-574924338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31b9d38-70c2-4d4c-8475-75481c4b41f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be67ed206ac409e867523381811f326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:29Z,use_quota=True,user_id='64d924c5a6964bbf8b9bc88e810ecdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf9ce32-d461-48c3-ae4c-6452ba1a7d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf9ce32-d461-48c3-ae4c-6452ba1a7d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fe25bb-f8fa-4e57-971d-192251336e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fe25bb-f8fa-4e57-971d-192251336e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31b9d38-70c2-4d4c-8475-75481c4b41f3', 'volume_name': 'volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e8064-4b6b-41ed-9e39-76005492f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e8064-4b6b-41ed-9e39-76005492f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f5d72-a1de-49ed-9768-230671a25db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:28 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Volume a31b9d38-70c2-4d4c-8475-75481c4b41f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3', 'volume_size': 1} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-574924338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31b9d38-70c2-4d4c-8475-75481c4b41f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be67ed206ac409e867523381811f326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:29Z,use_quota=True,user_id='64d924c5a6964bbf8b9bc88e810ecdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Creating volume a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:28 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:28 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 1073741824 Apr 01 08:11:28 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:29 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 1073741824" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:29 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:29 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:29 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f5d72-a1de-49ed-9768-230671a25db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b025ad8-be1c-4bde-b8c0-2bc0c7b7934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:29 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Volume volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 (a31b9d38-70c2-4d4c-8475-75481c4b41f3): created successfully Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b025ad8-be1c-4bde-b8c0-2bc0c7b7934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (ebceb4ab-7d80-47a2-a3b9-193c5870a2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0e15b41c-eff5-46a8-b85a-64e9811d95e2 tempest-VolumesDeleteCascade-1228465369 None] Created volume successfully. Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Creating offline snapshot 9e587c65-3350-45a7-8a95-72e910833f47 of volume a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf752c4-5013-47b5-a1df-3a1999276966]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:29 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:29 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:30 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:30 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 1G Apr 01 08:11:30 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:30 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 1G" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:30 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:30 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:31 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:31 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 is being set with open permissions: ugo+rw Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:31 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:31 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:31 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.373s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:31 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info Apr 01 08:11:31 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:31 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info" returned: 0 in 0.377s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:31 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info is being set with open permissions: ugo+rw Apr 01 08:11:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:31 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info Apr 01 08:11:31 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:32 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.info" returned: 0 in 0.373s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-184bce98-fbe3-4033-8bd2-a7475896e1d3 tempest-VolumesDeleteCascade-1228465369 None] Create snapshot completed successfully Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Creating offline snapshot a1987c97-3693-4676-a0af-f0b83673f8e1 of volume a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fad0a-65f0-42a3-abff-7cce5750d2c1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:33 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:33 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:33 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:33 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 1G Apr 01 08:11:33 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:33 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 1G" returned: 0 in 0.448s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:34 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:34 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:34 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.417s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:34 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 is being set with open permissions: ugo+rw Apr 01 08:11:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:34 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:34 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:34 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.737s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-526da3c2-c1db-4535-8303-8c4100d301a1 tempest-VolumesDeleteCascade-1228465369 None] Create snapshot completed successfully Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-a31b9d38-70c2-4d4c-8475-75481c4b41f3-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-a31b9d38-70c2-4d4c-8475-75481c4b41f3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Performing cascade delete. {{(pid=82084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-9e587c65-3350-45a7-8a95-72e910833f47-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-9e587c65-3350-45a7-8a95-72e910833f47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-9e587c65-3350-45a7-8a95-72e910833f47" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-9e587c65-3350-45a7-8a95-72e910833f47" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Deleting offline snapshot 9e587c65-3350-45a7-8a95-72e910833f47 of volume a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] snapshot_file for this snap is: volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec4e431-00b5-4488-883c-0547a4a2ac95]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:35 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:35 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:35 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74acd84-d5aa-40c9-b12f-feb3142064c1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:35 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:35 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:36 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c187e1-7acc-46b3-8345-27a082a20e72]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:36 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:36 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:36 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b9b56-2b61-4deb-b3fa-3f3fda36bfaf]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:36 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:36 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:36 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbef7954-8895-4118-af69-ef3ebc532338]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:37 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:37 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:37 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.429s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:37 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:37 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:37 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.407s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:37 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47 Apr 01 08:11:37 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:38 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.9e587c65-3350-45a7-8a95-72e910833f47" returned: 0 in 0.369s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 -F qcow2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:38 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 -F qcow2 Apr 01 08:11:38 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:38 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 -F qcow2" returned: 0 in 0.389s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-9e587c65-3350-45a7-8a95-72e910833f47" released by "_delete_snapshot" :: held 3.392s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" released by "delete_snapshot" :: held 3.404s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['e982abaf-793e-4a85-aced-d3d537493a8f', '9c4d9dd4-46aa-4cf4-991a-3c6d36e0b7fc', '65e5aa27-dc4e-47ac-ab4e-39fe35835070', '5cf4956c-83ef-4a16-a60e-c1f2b7eb6bbe'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Delete snapshot completed successfully. Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-9e587c65-3350-45a7-8a95-72e910833f47-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-a1987c97-3693-4676-a0af-f0b83673f8e1-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-a1987c97-3693-4676-a0af-f0b83673f8e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-a1987c97-3693-4676-a0af-f0b83673f8e1" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a1987c97-3693-4676-a0af-f0b83673f8e1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Deleting offline snapshot a1987c97-3693-4676-a0af-f0b83673f8e1 of volume a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] snapshot_file for this snap is: volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6460a33-a38e-4eb1-bfd8-48b9e948de7b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:38 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:38 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:39 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2518f009-bba0-4f33-9718-412c0054c3fb]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:39 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:39 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:39 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:39 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:39 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:40 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:40 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1 Apr 01 08:11:40 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:40 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3.a1987c97-3693-4676-a0af-f0b83673f8e1" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a1987c97-3693-4676-a0af-f0b83673f8e1" released by "_delete_snapshot" :: held 1.695s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" released by "delete_snapshot" :: held 1.707s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['76a84839-0927-4945-b040-a5f6f46937c2', 'a000cb42-d6fe-4722-8dba-ef179d9d1e44', '5e8eaf8e-90bb-46fa-97c9-6078d036e8b7', '63faff39-6e7e-430f-b179-5b6803cb6752'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Delete snapshot completed successfully. Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-a1987c97-3693-4676-a0af-f0b83673f8e1-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Snapshots deleted, issuing volume delete {{(pid=82084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56177e0-b9c9-48cb-b172-b6e7529c5a75]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:40 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:40 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:40 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:40 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3 Apr 01 08:11:40 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:41 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a31b9d38-70c2-4d4c-8475-75481c4b41f3" returned: 0 in 0.371s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-a31b9d38-70c2-4d4c-8475-75481c4b41f3" released by "delete_volume" :: held 0.829s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['02b2e36b-557b-435c-aee2-0900876ff906', 'd5bfde9a-43be-4295-9a6d-fc9c1523f894', 'fa5b7328-f76a-4231-8e4b-656c940ef308', '0353f136-b5a1-430d-a3d8-07061010c731'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:41 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:41 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:41 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.420s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:41 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Deleted volume successfully. Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9fc69746-7548-42f6-868e-dc584813f3eb tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-a31b9d38-70c2-4d4c-8475-75481c4b41f3-delete_volume" released by "delete_volume" :: held 6.693s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (049ccb3a-6ff8-4663-a153-6f0ab50b6b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1d3aad-1252-4f40-8c62-7707c85c5984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1d3aad-1252-4f40-8c62-7707c85c5984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1782708651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e12ec2-1fb1-4de2-87d7-cc984cb8dbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be67ed206ac409e867523381811f326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:42Z,use_quota=True,user_id='64d924c5a6964bbf8b9bc88e810ecdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff9435c-3ebf-4eeb-83d3-25789c3e760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff9435c-3ebf-4eeb-83d3-25789c3e760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d7505-efd1-4482-b0af-bb9fa281c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d7505-efd1-4482-b0af-bb9fa281c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e12ec2-1fb1-4de2-87d7-cc984cb8dbee', 'volume_name': 'volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b93b07-8089-447b-b49d-b121c4dc1270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b93b07-8089-447b-b49d-b121c4dc1270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724b934b-d824-44e0-a7e4-6b79733be958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Volume 59e12ec2-1fb1-4de2-87d7-cc984cb8dbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee', 'volume_size': 1} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1782708651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e12ec2-1fb1-4de2-87d7-cc984cb8dbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be67ed206ac409e867523381811f326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:42Z,use_quota=True,user_id='64d924c5a6964bbf8b9bc88e810ecdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Creating volume 59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:41 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:41 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee 1073741824 Apr 01 08:11:41 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:42 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee 1073741824" returned: 0 in 0.449s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:42 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:42 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:42 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724b934b-d824-44e0-a7e4-6b79733be958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9896a11-b611-493b-ba65-81986349a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Volume volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee (59e12ec2-1fb1-4de2-87d7-cc984cb8dbee): created successfully Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9896a11-b611-493b-ba65-81986349a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (049ccb3a-6ff8-4663-a153-6f0ab50b6b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-22918dcc-e795-40a2-ac25-c003677668a5 tempest-VolumesDeleteCascade-1228465369 None] Created volume successfully. Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Creating offline snapshot 074cc2c9-42f6-47cf-accc-41177f64e9f1 of volume 59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db8908-72ed-47a0-a8a5-4c570740ebab]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:43 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:43 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:43 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:43 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 1G Apr 01 08:11:43 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:43 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 1G" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:43 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:43 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:44 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.396s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:44 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 is being set with open permissions: ugo+rw Apr 01 08:11:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:44 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:44 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:44 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.368s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:44 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info Apr 01 08:11:44 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:45 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info" returned: 0 in 0.379s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:45 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info is being set with open permissions: ugo+rw Apr 01 08:11:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:45 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info Apr 01 08:11:45 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:45 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.info" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e576a6d3-cea6-4de7-a515-16b843e8cc4d tempest-VolumesDeleteCascade-1228465369 None] Create snapshot completed successfully Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (5e834c8f-d3d2-47a6-95ee-c494a0f09e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f5d933-2af1-44b3-a400-e54102e08d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f5d933-2af1-44b3-a400-e54102e08d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1974530684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b86228-84ae-45c2-b192-7123b3dfce0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be67ed206ac409e867523381811f326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=074cc2c9-42f6-47cf-accc-41177f64e9f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:46Z,use_quota=True,user_id='64d924c5a6964bbf8b9bc88e810ecdd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40408b55-abc8-4965-be4c-488987ee7c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40408b55-abc8-4965-be4c-488987ee7c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc978ba-214e-4872-b7b2-33a01483e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc978ba-214e-4872-b7b2-33a01483e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '65b86228-84ae-45c2-b192-7123b3dfce0c', 'volume_name': 'volume-65b86228-84ae-45c2-b192-7123b3dfce0c', 'volume_size': 1, 'snapshot_id': '074cc2c9-42f6-47cf-accc-41177f64e9f1'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3934855a-763e-4a7e-b72a-8fe796cb1970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3934855a-763e-4a7e-b72a-8fe796cb1970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fa9a26-6249-4d00-a44c-c388e464e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:46 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Volume 65b86228-84ae-45c2-b192-7123b3dfce0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-65b86228-84ae-45c2-b192-7123b3dfce0c', 'volume_size': 1, 'snapshot_id': '074cc2c9-42f6-47cf-accc-41177f64e9f1'} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1-65b86228-84ae-45c2-b192-7123b3dfce0c" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1-65b86228-84ae-45c2-b192-7123b3dfce0c" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Creating volume 65b86228-84ae-45c2-b192-7123b3dfce0c from snapshot 074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] snapshot: 074cc2c9-42f6-47cf-accc-41177f64e9f1, volume: 65b86228-84ae-45c2-b192-7123b3dfce0c, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6200de45-07c7-4459-954f-7840fce186a8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:46 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:46 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:46 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf77c53-b9ef-4061-bf5e-4dd6d1fb1e46]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:47 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:47 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:47 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:47 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:11:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:47 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c Apr 01 08:11:47 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:49 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c" returned: 0 in 1.783s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88bc221-5b7c-4120-8233-f5347592038b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:49 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:49 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:49 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.568s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee, size 1024.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:11:49 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Converted 1024.00 MB image at 573.97 MB/s Apr 01 08:11:49 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c is being set with open permissions: ugo+rw Apr 01 08:11:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:49 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c Apr 01 08:11:49 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:50 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c" returned: 0 in 0.387s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" released by "_copy_volume_from_snapshot" :: held 3.681s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1-65b86228-84ae-45c2-b192-7123b3dfce0c" released by "_create_volume_from_snapshot" :: held 3.696s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.706s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fa9a26-6249-4d00-a44c-c388e464e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b86228-84ae-45c2-b192-7123b3dfce0c', 'volume_size': 1, 'snapshot_id': '074cc2c9-42f6-47cf-accc-41177f64e9f1'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71858b2a-c8cf-4e0b-8ba8-e064c8d6771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:50 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Volume volume-65b86228-84ae-45c2-b192-7123b3dfce0c (65b86228-84ae-45c2-b192-7123b3dfce0c): created successfully Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71858b2a-c8cf-4e0b-8ba8-e064c8d6771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Flow 'volume_create_manager' (5e834c8f-d3d2-47a6-95ee-c494a0f09e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a0d8cbe3-997c-45ae-a940-8c7fbd58a5b9 tempest-VolumesDeleteCascade-1228465369 None] Created volume successfully. Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Performing cascade delete. {{(pid=82084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-074cc2c9-42f6-47cf-accc-41177f64e9f1-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-074cc2c9-42f6-47cf-accc-41177f64e9f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Deleting offline snapshot 074cc2c9-42f6-47cf-accc-41177f64e9f1 of volume 59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] snapshot_file for this snap is: volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfd57f-a116-4ae2-b0a7-ed4b4dc9fdbe]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:50 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:50 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:51 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6872cb-e986-44d7-92b5-9e6473886f22]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:51 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:51 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:51 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:51 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:51 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:52 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:52 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1 Apr 01 08:11:52 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:52 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee.074cc2c9-42f6-47cf-accc-41177f64e9f1" returned: 0 in 0.369s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-074cc2c9-42f6-47cf-accc-41177f64e9f1" released by "_delete_snapshot" :: held 1.746s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" released by "delete_snapshot" :: held 1.756s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['a9de5973-64d2-4671-8228-f1cf376b3ab8', '9823b02c-11b0-4b1a-9724-a0fd4a57be26', 'e259421f-346c-463a-939a-ad32c41c2bce', '9de4248e-fde8-44f0-b0de-e921b30ee3ed'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Delete snapshot completed successfully. Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-074cc2c9-42f6-47cf-accc-41177f64e9f1-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Snapshots deleted, issuing volume delete {{(pid=82084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f28a2-b9a0-464b-bc5b-d5f962582044]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:52 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:52 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:53 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:53 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee Apr 01 08:11:53 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:53 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" returned: 0 in 0.374s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee" released by "delete_volume" :: held 0.833s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['80c015a1-6a13-4ce9-b362-e58d027440f4', '7e9d6162-0831-4115-be80-32cebd2a37b9', '9c70f185-d436-4e87-ab9d-11bb4babee49', 'a60c58fb-6bb8-436f-8129-df9f9538e28d'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:53 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:53 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:53 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Deleted volume successfully. Apr 01 08:11:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1e2c6289-c7bc-4c88-9a0e-23c3ee9ad4e1 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-59e12ec2-1fb1-4de2-87d7-cc984cb8dbee-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-65b86228-84ae-45c2-b192-7123b3dfce0c-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-65b86228-84ae-45c2-b192-7123b3dfce0c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c710003-61ab-400d-994b-e6fa97d42e62]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:54 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c Apr 01 08:11:54 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:54 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:54 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c Apr 01 08:11:54 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:54 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-65b86228-84ae-45c2-b192-7123b3dfce0c" returned: 0 in 0.371s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-quobyte-65b86228-84ae-45c2-b192-7123b3dfce0c" released by "delete_volume" :: held 0.836s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Created reservations ['1ff8c53b-0111-46eb-953a-b9af0cb6f86f', '4ca614f6-a6fd-4462-ab54-07c240be30e3', '56853a8e-3cfd-4561-a60b-6361a64abf67', '99fb847d-a427-437a-a703-35bd28f21b38'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:54 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:54 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:55 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.438s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Deleted volume successfully. Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1ea32a6d-0c83-4c0d-8edf-83d1d6d7a456 tempest-VolumesDeleteCascade-1228465369 None] Lock "cinder-65b86228-84ae-45c2-b192-7123b3dfce0c-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:55 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:11:55 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:56 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.416s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=129,cinder:SELECT=97,cinder:INSERT=28,cinder:DELETE=13 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=98,cinder:UPDATE=117,cinder:DELETE=8,cinder:INSERT=32 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Flow 'volume_create_manager' (7ba2ab86-3c4e-4889-a044-72aac65f9bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf46845-34a6-467e-a1cc-28158e3ce580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf46845-34a6-467e-a1cc-28158e3ce580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-183363853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57489174-42c7-457f-81f3-250d8b852986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e371477df704d5f87202fcc98e23b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:57Z,use_quota=True,user_id='4dd3023c4a5f48b5bc8ecc2c993f8bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14734f1-95c3-49fe-8834-7601b09b4794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14734f1-95c3-49fe-8834-7601b09b4794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b952054c-f4a6-4df4-ad07-db03667b37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b952054c-f4a6-4df4-ad07-db03667b37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57489174-42c7-457f-81f3-250d8b852986', 'volume_name': 'volume-57489174-42c7-457f-81f3-250d8b852986', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91ae775-761d-43a7-8e66-900e48e23b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91ae775-761d-43a7-8e66-900e48e23b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3261458c-285f-412a-a63b-09af0572d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Volume 57489174-42c7-457f-81f3-250d8b852986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57489174-42c7-457f-81f3-250d8b852986', 'volume_size': 1} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-183363853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57489174-42c7-457f-81f3-250d8b852986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e371477df704d5f87202fcc98e23b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:57Z,use_quota=True,user_id='4dd3023c4a5f48b5bc8ecc2c993f8bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Creating volume 57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:11:56 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:11:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:57 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 1073741824 Apr 01 08:11:57 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:57 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 1073741824" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:57 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:11:57 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:57 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3261458c-285f-412a-a63b-09af0572d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57489174-42c7-457f-81f3-250d8b852986', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f1383-39a6-47c4-a02a-8cf1e9ef706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Volume volume-57489174-42c7-457f-81f3-250d8b852986 (57489174-42c7-457f-81f3-250d8b852986): created successfully Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f1383-39a6-47c4-a02a-8cf1e9ef706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Flow 'volume_create_manager' (7ba2ab86-3c4e-4889-a044-72aac65f9bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-40922980-ec66-4d4e-b95e-0e8df3fb81ac tempest-VolumesCloneTest-1939360352 None] Created volume successfully. Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Flow 'volume_create_manager' (2e67e38b-7c8a-407b-8d4c-8b46a8a41aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb45a09-f269-4953-a35a-e0f001d2c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb45a09-f269-4953-a35a-e0f001d2c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1722058001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc77320-95a1-4007-ad74-e3395336bdab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e371477df704d5f87202fcc98e23b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:11:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=57489174-42c7-457f-81f3-250d8b852986,status='creating',terminated_at=None,updated_at=2026-04-01T06:11:58Z,use_quota=True,user_id='4dd3023c4a5f48b5bc8ecc2c993f8bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1d4c1-f522-4167-baab-a3e9b88e127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1d4c1-f522-4167-baab-a3e9b88e127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d496d913-2ea3-43f4-9455-a71a7c832579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d496d913-2ea3-43f4-9455-a71a7c832579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dbc77320-95a1-4007-ad74-e3395336bdab', 'volume_name': 'volume-dbc77320-95a1-4007-ad74-e3395336bdab', 'volume_size': 2, 'source_volid': '57489174-42c7-457f-81f3-250d8b852986', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0ca97-22cf-494f-86f9-a6fda9365d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0ca97-22cf-494f-86f9-a6fda9365d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c521e5-2145-4b5e-8e01-781991c8042b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:11:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Volume dbc77320-95a1-4007-ad74-e3395336bdab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dbc77320-95a1-4007-ad74-e3395336bdab', 'volume_size': 2, 'source_volid': '57489174-42c7-457f-81f3-250d8b852986', 'source_volstatus': 'available'} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:11:58 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Cloning volume 57489174-42c7-457f-81f3-250d8b852986 to volume dbc77320-95a1-4007-ad74-e3395336bdab Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Creating offline snapshot 7f02042b-c1f0-47f6-a707-9111f1727a89 of volume 57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[43378b28-d6e5-4d2a-ad10-f9ebb7b6c327]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:58 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:11:58 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:58 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:58 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 1G Apr 01 08:11:58 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:59 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 1G" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57489174-42c7-457f-81f3-250d8b852986 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:59 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57489174-42c7-457f-81f3-250d8b852986 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:11:59 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:59 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57489174-42c7-457f-81f3-250d8b852986 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.391s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:59 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 is being set with open permissions: ugo+rw Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:11:59 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:11:59 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:11:59 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:11:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:00 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info Apr 01 08:12:00 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:00 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info" returned: 0 in 0.386s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:00 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info is being set with open permissions: ugo+rw Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:00 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info Apr 01 08:12:00 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:00 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.info" returned: 0 in 0.369s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] snapshot: 7f02042b-c1f0-47f6-a707-9111f1727a89, volume: dbc77320-95a1-4007-ad74-e3395336bdab, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc8a68-b354-43dc-93f2-8abf3aa09437]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:00 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:12:00 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:01 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.435s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57489174-42c7-457f-81f3-250d8b852986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[557fd360-d9f8-4114-9b3e-772816631ef4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:01 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:12:01 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:01 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:12:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:01 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab Apr 01 08:12:01 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:03 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab" returned: 0 in 1.846s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2db87-f63f-4c7d-a3c6-681391ab6cf6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:03 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:12:03 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:04 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.572s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:12:04 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Converted 1024.00 MB image at 554.31 MB/s Apr 01 08:12:04 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab is being set with open permissions: ugo+rw Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:04 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab Apr 01 08:12:04 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:04 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" released by "_copy_volume_from_snapshot" :: held 3.762s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-quobyte-7f02042b-c1f0-47f6-a707-9111f1727a89" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-7f02042b-c1f0-47f6-a707-9111f1727a89" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Deleting offline snapshot 7f02042b-c1f0-47f6-a707-9111f1727a89 of volume 57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] snapshot_file for this snap is: volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad224b13-8186-495f-881e-c9609777695a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:04 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:12:04 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:04 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57489174-42c7-457f-81f3-250d8b852986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[88285751-11c0-4224-a99a-4cbc1ac0ab41]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:05 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:12:05 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:05 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.464s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:05 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:12:05 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:05 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:05 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89 Apr 01 08:12:05 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:06 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986.7f02042b-c1f0-47f6-a707-9111f1727a89" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-7f02042b-c1f0-47f6-a707-9111f1727a89" released by "_delete_snapshot" :: held 1.772s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.036s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c521e5-2145-4b5e-8e01-781991c8042b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc77320-95a1-4007-ad74-e3395336bdab', 'volume_size': 2, 'source_volid': '57489174-42c7-457f-81f3-250d8b852986', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761e1f35-aa74-4644-b8de-fb512a0433a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:06 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Volume volume-dbc77320-95a1-4007-ad74-e3395336bdab (dbc77320-95a1-4007-ad74-e3395336bdab): created successfully Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761e1f35-aa74-4644-b8de-fb512a0433a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Flow 'volume_create_manager' (2e67e38b-7c8a-407b-8d4c-8b46a8a41aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f5b2e8e4-17c0-4bf4-8843-c5752ebd18c7 tempest-VolumesCloneTest-1939360352 None] Created volume successfully. Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-dbc77320-95a1-4007-ad74-e3395336bdab-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-dbc77320-95a1-4007-ad74-e3395336bdab-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718637c-a68d-433d-87c4-efeab3c026f8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:06 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab Apr 01 08:12:06 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:07 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:07 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab Apr 01 08:12:07 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:07 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-dbc77320-95a1-4007-ad74-e3395336bdab" returned: 0 in 0.396s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-dbc77320-95a1-4007-ad74-e3395336bdab" released by "delete_volume" :: held 0.852s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Created reservations ['35db3cef-23f6-48ba-a628-9dd07a60918c', '3c97c74a-7d52-4d7e-aa76-bd4e72b7805b', '6722f3bc-70d8-4645-82b1-4cd5b2d9648b', 'e9ec7afd-3f53-4291-8b12-127463ce5780'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:07 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:07 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-57489174-42c7-457f-81f3-250d8b852986-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "cinder-57489174-42c7-457f-81f3-250d8b852986-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Acquiring lock "cinder-quobyte-57489174-42c7-457f-81f3-250d8b852986" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-57489174-42c7-457f-81f3-250d8b852986" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7820286-2f94-46ca-8617-d74ca210cef3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:08 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:12:08 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:08 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Deleted volume successfully. Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-40433f1c-9107-4645-bf53-61ae783ba013 tempest-VolumesCloneTest-1939360352 None] Lock "cinder-dbc77320-95a1-4007-ad74-e3395336bdab-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:08 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:08 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986 Apr 01 08:12:08 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:08 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-57489174-42c7-457f-81f3-250d8b852986" returned: 0 in 0.373s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "cinder-quobyte-57489174-42c7-457f-81f3-250d8b852986" released by "delete_volume" :: held 0.868s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Created reservations ['d45465f9-9df4-41df-8d7f-55a8f7a607b4', '66303b27-d884-4d7e-bcef-e50a433b6f1a', 'bcd6eee0-995d-44b7-97ea-02e82cfbe49f', 'f2afac8e-9530-440a-a896-fe8b65ce7857'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:08 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:08 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:09 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:09 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:09 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Deleted volume successfully. Apr 01 08:12:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-19d2f6fc-0b16-4640-a996-af253979d66c tempest-VolumesCloneTest-1939360352 None] Lock "cinder-57489174-42c7-457f-81f3-250d8b852986-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Flow 'volume_create_manager' (a0e28ef6-74e3-47ae-9362-82569017cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377ffcfa-b6a1-44d6-ab53-7d146b36e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377ffcfa-b6a1-44d6-ab53-7d146b36e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-596055295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac7a5a77b04f8d9c4fd1654f53355c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:11Z,use_quota=True,user_id='44cd505f5fdb4ac3ad2d58b871acf689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73846816-8ccd-424e-850b-8e2c603bd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73846816-8ccd-424e-850b-8e2c603bd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe125b0-cbf9-468e-b9df-09f6970dadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe125b0-cbf9-468e-b9df-09f6970dadde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c', 'volume_name': 'volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c', 'volume_size': 2}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc0927-59ca-4111-b92e-8100f43ba287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc0927-59ca-4111-b92e-8100f43ba287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c737dd54-272c-42a3-a177-f2297e175f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:10 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Volume 18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c', 'volume_size': 2} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-596055295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ac7a5a77b04f8d9c4fd1654f53355c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:11Z,use_quota=True,user_id='44cd505f5fdb4ac3ad2d58b871acf689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Creating volume 18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:10 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c 2147483648 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:10 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c 2147483648 Apr 01 08:12:10 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:11 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c 2147483648" returned: 0 in 0.458s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:11 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c Apr 01 08:12:11 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:11 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" returned: 0 in 0.377s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c737dd54-272c-42a3-a177-f2297e175f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c', 'volume_size': 2}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d88f02-6f0e-4220-8985-3542ec4dc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:11 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Volume volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c (18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c): created successfully Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d88f02-6f0e-4220-8985-3542ec4dc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Flow 'volume_create_manager' (a0e28ef6-74e3-47ae-9362-82569017cb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:11 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d974c68a-1777-46e2-8eb0-08ee81d0d8cf tempest-VolumesCloneNegativeTest-423857558 None] Created volume successfully. Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Acquiring lock "cinder-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "cinder-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Acquiring lock "cinder-quobyte-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "cinder-quobyte-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf4674b-7669-4bb4-bc80-482c4ede4490]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:12 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c Apr 01 08:12:12 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:12 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:12 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c Apr 01 08:12:12 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:12 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" returned: 0 in 0.369s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "cinder-quobyte-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c" released by "delete_volume" :: held 0.823s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Created reservations ['f1f880c9-413a-49f7-809b-28502a67a659', 'c7841618-9b68-49cd-935a-642751d32144', '7eb04213-4c61-4640-8965-3b117062df78', 'ebf6c55a-bc37-45c6-ab70-d74f0fe599fa'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:12 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:12 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:13 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.421s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:13 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Deleted volume successfully. Apr 01 08:12:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-52f02699-6fac-400f-adcf-337f81f5fa69 tempest-VolumesCloneNegativeTest-423857558 None] Lock "cinder-18f5d1da-2fd8-4bf8-a06b-e4f40f69a31c-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (b2e5cb9c-32a5-4712-ba6e-fbdd05ce7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a716a-5716-4a20-8b7d-d828482849e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a716a-5716-4a20-8b7d-d828482849e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-341089026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226244b0-dae9-48d7-ab0e-2160165d9abd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:15Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79096d91-740d-4034-b57d-1ff84080cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79096d91-740d-4034-b57d-1ff84080cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19e1a14-6c03-4de2-aa5b-72b15aec060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19e1a14-6c03-4de2-aa5b-72b15aec060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226244b0-dae9-48d7-ab0e-2160165d9abd', 'volume_name': 'volume-226244b0-dae9-48d7-ab0e-2160165d9abd', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06650f50-04c1-4b0f-ace4-688e6c6a89d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06650f50-04c1-4b0f-ace4-688e6c6a89d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f841cf7-5ab3-4e88-9f00-b704857b3552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Volume 226244b0-dae9-48d7-ab0e-2160165d9abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226244b0-dae9-48d7-ab0e-2160165d9abd', 'volume_size': 1} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-341089026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226244b0-dae9-48d7-ab0e-2160165d9abd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:15Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Creating volume 226244b0-dae9-48d7-ab0e-2160165d9abd {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:14 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:14 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd 1073741824 Apr 01 08:12:14 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:15 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd 1073741824" returned: 0 in 0.460s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:15 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd Apr 01 08:12:15 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:15 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd" returned: 0 in 0.377s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f841cf7-5ab3-4e88-9f00-b704857b3552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226244b0-dae9-48d7-ab0e-2160165d9abd', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe84316-617b-405b-a5e8-933df16992ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Volume volume-226244b0-dae9-48d7-ab0e-2160165d9abd (226244b0-dae9-48d7-ab0e-2160165d9abd): created successfully Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe84316-617b-405b-a5e8-933df16992ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (b2e5cb9c-32a5-4712-ba6e-fbdd05ce7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-abe4c269-4385-4f75-ae71-476b73dfb4e4 tempest-VolumesListTestJSON-1436431880 None] Created volume successfully. Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (ef64c67b-9777-4f5d-97d1-3afc6cb872e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2d7e8-e08f-4a1c-a278-9a42bded5606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2d7e8-e08f-4a1c-a278-9a42bded5606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942111489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56233d7-6e28-4ff6-b646-1fc6f82a13d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:16Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598225fa-fa7f-4e66-8402-46f34f8bfda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598225fa-fa7f-4e66-8402-46f34f8bfda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1656e-96ea-4e12-acf6-bc24339d3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1656e-96ea-4e12-acf6-bc24339d3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56233d7-6e28-4ff6-b646-1fc6f82a13d5', 'volume_name': 'volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0e5267-86f3-4a4e-bdc2-706e310bde1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0e5267-86f3-4a4e-bdc2-706e310bde1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ca34b0-cb6e-41fd-b315-6fdcf6dfc1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Volume d56233d7-6e28-4ff6-b646-1fc6f82a13d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5', 'volume_size': 1} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942111489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56233d7-6e28-4ff6-b646-1fc6f82a13d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:16Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Creating volume d56233d7-6e28-4ff6-b646-1fc6f82a13d5 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:16 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:16 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 1073741824 Apr 01 08:12:16 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:16 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 1073741824" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:16 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 Apr 01 08:12:16 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:16 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ca34b0-cb6e-41fd-b315-6fdcf6dfc1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a824d04-d0ef-402a-a6ca-e3d6034d2ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:16 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Volume volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 (d56233d7-6e28-4ff6-b646-1fc6f82a13d5): created successfully Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a824d04-d0ef-402a-a6ca-e3d6034d2ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (ef64c67b-9777-4f5d-97d1-3afc6cb872e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:16 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-91cd11ea-056d-459a-b0a0-d84b4192e6da tempest-VolumesListTestJSON-1436431880 None] Created volume successfully. Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (4806a363-86f3-4aef-b8b6-6d512a5718a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8284ac27-4b5d-4879-a809-9de4bd88ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8284ac27-4b5d-4879-a809-9de4bd88ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-130125694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cfe106-902f-4b87-8905-a31a6f520bfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:17Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f0b943-fe59-4a50-b221-3c6e34f1c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f0b943-fe59-4a50-b221-3c6e34f1c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b78af02-7e14-4721-97ed-d4a6232b18f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b78af02-7e14-4721-97ed-d4a6232b18f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cfe106-902f-4b87-8905-a31a6f520bfa', 'volume_name': 'volume-f2cfe106-902f-4b87-8905-a31a6f520bfa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e43c304-c63e-4371-9f00-bdd85ae080fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e43c304-c63e-4371-9f00-bdd85ae080fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b332ac58-7d74-426a-b3a9-821cac8ac51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Volume f2cfe106-902f-4b87-8905-a31a6f520bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cfe106-902f-4b87-8905-a31a6f520bfa', 'volume_size': 1} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-130125694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cfe106-902f-4b87-8905-a31a6f520bfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a010d9421844d05a061ab3b74d16624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:17Z,use_quota=True,user_id='8a0f7b37e417416794991778bfaf098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Creating volume f2cfe106-902f-4b87-8905-a31a6f520bfa {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:17 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:17 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa 1073741824 Apr 01 08:12:17 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:17 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa 1073741824" returned: 0 in 0.445s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:17 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa Apr 01 08:12:17 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:18 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b332ac58-7d74-426a-b3a9-821cac8ac51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cfe106-902f-4b87-8905-a31a6f520bfa', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68663512-1f0d-49dd-a25e-815e748c2b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:18 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Volume volume-f2cfe106-902f-4b87-8905-a31a6f520bfa (f2cfe106-902f-4b87-8905-a31a6f520bfa): created successfully Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68663512-1f0d-49dd-a25e-815e748c2b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Flow 'volume_create_manager' (4806a363-86f3-4aef-b8b6-6d512a5718a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ccadce32-a8d5-46c7-ab08-19149954c35e tempest-VolumesListTestJSON-1436431880 None] Created volume successfully. Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-f2cfe106-902f-4b87-8905-a31a6f520bfa-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-f2cfe106-902f-4b87-8905-a31a6f520bfa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-quobyte-f2cfe106-902f-4b87-8905-a31a6f520bfa" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-f2cfe106-902f-4b87-8905-a31a6f520bfa" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d658296b-7069-4bd9-b570-8ec78b971064]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:20 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa Apr 01 08:12:20 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:20 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa" returned: 0 in 0.450s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:20 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa Apr 01 08:12:20 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:21 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f2cfe106-902f-4b87-8905-a31a6f520bfa" returned: 0 in 0.382s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-f2cfe106-902f-4b87-8905-a31a6f520bfa" released by "delete_volume" :: held 0.854s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Created reservations ['4f78d609-9b3a-4fad-bda7-2b3d77221b7a', 'a15a1819-13df-4ab6-8bc2-f872e379f650', '7b32b47a-a569-4b90-acbf-c44e4c3ce50e', '83bf8ac9-10d8-4993-95e8-218898ad7af3'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:21 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:21 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-d56233d7-6e28-4ff6-b646-1fc6f82a13d5-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-d56233d7-6e28-4ff6-b646-1fc6f82a13d5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-quobyte-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6454d6e-8980-4d1f-a974-0846dd160b4d]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:21 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 Apr 01 08:12:21 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:21 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:21 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Deleted volume successfully. Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-29448431-c07c-4e22-8bb1-44693d6b92ba tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-f2cfe106-902f-4b87-8905-a31a6f520bfa-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:21 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:21 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5 Apr 01 08:12:21 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:22 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" returned: 0 in 0.381s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-d56233d7-6e28-4ff6-b646-1fc6f82a13d5" released by "delete_volume" :: held 0.840s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Created reservations ['7ce8c0fa-455d-4ec9-bd7e-bedb6782d082', '950bed3c-c2dd-47a1-9b16-46b13cd7df31', 'f3372e50-1e6a-4aa9-ac7a-43e0be546528', 'ee2f7ac3-c61e-49ba-bc01-a2b37ea3f6b9'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:22 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:22 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-226244b0-dae9-48d7-ab0e-2160165d9abd-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-226244b0-dae9-48d7-ab0e-2160165d9abd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "cinder-quobyte-226244b0-dae9-48d7-ab0e-2160165d9abd" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-226244b0-dae9-48d7-ab0e-2160165d9abd" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c293f-9939-4aee-b36e-93cc0592fe31]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:22 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd Apr 01 08:12:22 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:22 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.411s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Deleted volume successfully. Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e86126f0-09e2-40fe-a863-14e3612b7520 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-d56233d7-6e28-4ff6-b646-1fc6f82a13d5-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:22 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:22 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd Apr 01 08:12:22 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:23 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-226244b0-dae9-48d7-ab0e-2160165d9abd" returned: 0 in 0.391s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-quobyte-226244b0-dae9-48d7-ab0e-2160165d9abd" released by "delete_volume" :: held 0.858s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Created reservations ['d7cef8e0-5ea8-4ed4-a036-5b2ae5b7acac', 'a6474d1b-3705-48d6-8443-44e21bbfc251', '79a90f76-97ad-4f84-b01c-25e3b493846d', 'fab6904b-8908-47d4-aaae-bddf9d1df483'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:23 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:23 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:23 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Deleted volume successfully. Apr 01 08:12:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ecf733ec-1c13-420c-a7f0-29c77ecce646 tempest-VolumesListTestJSON-1436431880 None] Lock "cinder-226244b0-dae9-48d7-ab0e-2160165d9abd-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Flow 'volume_create_manager' (a905641d-9add-43d3-b271-80239c999e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b7c61f-e324-4a40-bebd-ce22312cc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b7c61f-e324-4a40-bebd-ce22312cc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-65310244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710c081f-d5a3-40b7-9333-7a46ea1d7226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13150aeb9834bc39b1edb44d382e855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:25Z,use_quota=True,user_id='8dff949ff7434c1f89b98209c96dd1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37450b4f-436e-4190-8f39-0d5706d5f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37450b4f-436e-4190-8f39-0d5706d5f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77745d06-d2ad-4de3-a700-fb02e0692742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77745d06-d2ad-4de3-a700-fb02e0692742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710c081f-d5a3-40b7-9333-7a46ea1d7226', 'volume_name': 'volume-710c081f-d5a3-40b7-9333-7a46ea1d7226', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018663af-fce4-4118-80fa-20802868899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018663af-fce4-4118-80fa-20802868899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f761071-76e7-43f3-b3d8-71d27b38c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:25 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Volume 710c081f-d5a3-40b7-9333-7a46ea1d7226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710c081f-d5a3-40b7-9333-7a46ea1d7226', 'volume_size': 1} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-65310244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710c081f-d5a3-40b7-9333-7a46ea1d7226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13150aeb9834bc39b1edb44d382e855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:25Z,use_quota=True,user_id='8dff949ff7434c1f89b98209c96dd1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Creating volume 710c081f-d5a3-40b7-9333-7a46ea1d7226 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:25 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:25 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 1073741824 Apr 01 08:12:25 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:25 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 1073741824" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:25 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 Apr 01 08:12:25 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:26 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f761071-76e7-43f3-b3d8-71d27b38c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710c081f-d5a3-40b7-9333-7a46ea1d7226', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119777be-fc76-41fa-8ab4-042815175084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:26 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Volume volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 (710c081f-d5a3-40b7-9333-7a46ea1d7226): created successfully Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119777be-fc76-41fa-8ab4-042815175084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Flow 'volume_create_manager' (a905641d-9add-43d3-b271-80239c999e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-00a7ef96-9c0c-4748-8802-a4ddea59f9cf tempest-VolumesNegativeTest-752115053 None] Created volume successfully. Apr 01 08:12:36 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=50,cinder:UPDATE=59,cinder:INSERT=19,cinder:DELETE=3 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:12:36 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=43,cinder:UPDATE=81,cinder:DELETE=10,cinder:INSERT=14 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:12:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Acquiring lock "cinder-710c081f-d5a3-40b7-9333-7a46ea1d7226-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "cinder-710c081f-d5a3-40b7-9333-7a46ea1d7226-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Acquiring lock "cinder-quobyte-710c081f-d5a3-40b7-9333-7a46ea1d7226" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "cinder-quobyte-710c081f-d5a3-40b7-9333-7a46ea1d7226" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d28da-c695-4cc3-86f3-d1fffe067ac7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:49 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 Apr 01 08:12:49 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:49 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:49 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226 Apr 01 08:12:49 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:49 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-710c081f-d5a3-40b7-9333-7a46ea1d7226" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "cinder-quobyte-710c081f-d5a3-40b7-9333-7a46ea1d7226" released by "delete_volume" :: held 0.813s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Created reservations ['2bce37b1-bebf-4844-b99f-4efd749a1973', '58b675a8-7160-4abd-a3c0-006d07040379', 'b1202293-c08e-43e4-a16f-669de11b88b3', '46d74581-b9df-4307-b771-e719317a96b2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:49 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:49 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:50 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:50 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Deleted volume successfully. Apr 01 08:12:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6be8fc5e-0e81-4fe9-9d17-e321f3464d38 tempest-VolumesNegativeTest-752115053 None] Lock "cinder-710c081f-d5a3-40b7-9333-7a46ea1d7226-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:55 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:12:55 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:56 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.451s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (c818343f-8b80-4909-9a63-f8592053598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd61223-8f1e-49ec-adad-78cd292a77ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd61223-8f1e-49ec-adad-78cd292a77ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984899775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edb1d95-89d9-479b-9fb4-bbd759f6ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:58Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d942388-94ec-44a0-affc-cd3c3732fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d942388-94ec-44a0-affc-cd3c3732fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5615ff92-c980-4f0c-864a-c5c9fbb1f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5615ff92-c980-4f0c-864a-c5c9fbb1f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edb1d95-89d9-479b-9fb4-bbd759f6ce12', 'volume_name': 'volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79932ae7-c277-498b-8f5e-97d4c99ac877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79932ae7-c277-498b-8f5e-97d4c99ac877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eca3866-307a-4a98-a754-53d2c737417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Volume 7edb1d95-89d9-479b-9fb4-bbd759f6ce12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12', 'volume_size': 1} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984899775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edb1d95-89d9-479b-9fb4-bbd759f6ce12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:12:58Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Creating volume 7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:12:58 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:58 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 1073741824 Apr 01 08:12:58 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:58 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 1073741824" returned: 0 in 0.445s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:58 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 Apr 01 08:12:58 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:12:59 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eca3866-307a-4a98-a754-53d2c737417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f566c5e-9e0d-4396-ba63-3f047e30a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:12:59 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Volume volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 (7edb1d95-89d9-479b-9fb4-bbd759f6ce12): created successfully Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f566c5e-9e0d-4396-ba63-3f047e30a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (c818343f-8b80-4909-9a63-f8592053598d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:12:59 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-301eae22-bf2a-433e-9662-87a9d9c1cde7 tempest-VolumesSnapshotTestJSON-27808219 None] Created volume successfully. Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Creating offline snapshot b4e6d17a-489c-4270-b157-bfcfb08e0a1c of volume 7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca332171-9f46-48bf-9a8d-e3b53a9bfb12]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:12:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:12:59 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 Apr 01 08:12:59 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:00 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:00 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c 1G Apr 01 08:13:00 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:00 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c 1G" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:00 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c Apr 01 08:13:00 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:00 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:00 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c is being set with open permissions: ugo+rw Apr 01 08:13:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:00 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c Apr 01 08:13:00 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:01 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c" returned: 0 in 0.374s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:01 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info Apr 01 08:13:01 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:01 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info" returned: 0 in 0.377s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info is being set with open permissions: ugo+rw Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:01 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info Apr 01 08:13:01 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:01 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.info" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3dbde7ce-e555-4ad9-b899-6326b0dcb2c3 tempest-VolumesSnapshotTestJSON-27808219 None] Create snapshot completed successfully Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-b4e6d17a-489c-4270-b157-bfcfb08e0a1c-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-b4e6d17a-489c-4270-b157-bfcfb08e0a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-b4e6d17a-489c-4270-b157-bfcfb08e0a1c" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-b4e6d17a-489c-4270-b157-bfcfb08e0a1c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Deleting offline snapshot b4e6d17a-489c-4270-b157-bfcfb08e0a1c of volume 7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] snapshot_file for this snap is: volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61949466-7618-406d-9cd2-a1235523f7bf]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:02 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c Apr 01 08:13:02 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:03 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3165f0e-3155-4834-9d42-969a9eba5043]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:03 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 Apr 01 08:13:03 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:03 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:03 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c Apr 01 08:13:03 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:04 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:04 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c Apr 01 08:13:04 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:04 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12.b4e6d17a-489c-4270-b157-bfcfb08e0a1c" returned: 0 in 0.368s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-b4e6d17a-489c-4270-b157-bfcfb08e0a1c" released by "_delete_snapshot" :: held 1.710s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" released by "delete_snapshot" :: held 1.719s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['cfa3353b-426f-4136-8aec-c90c192316de', 'd68b422c-193b-455a-9a91-d60efe2d72fb', '5ea677d4-590b-44c7-b1f0-37ee6159f6f4', 'bec955b1-2219-4164-80a1-3fea21416e78'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Delete snapshot completed successfully. Apr 01 08:13:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-599d613f-b169-4448-b032-b90b757f4458 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-b4e6d17a-489c-4270-b157-bfcfb08e0a1c-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (9a0eb80c-3d8d-4050-a44e-ac0678981694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d702c767-5ca0-4b98-b545-24b4e87ba78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d702c767-5ca0-4b98-b545-24b4e87ba78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-322025988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0151b20c-be3e-49d7-9c36-f801f6e4d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:05Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7610e796-83e0-4044-9668-13d557625309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7610e796-83e0-4044-9668-13d557625309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918873a5-eee4-45c4-bf4f-f1c422626cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918873a5-eee4-45c4-bf4f-f1c422626cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0151b20c-be3e-49d7-9c36-f801f6e4d4e1', 'volume_name': 'volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7677d4-75d8-4b22-a7d0-7a9461888144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7677d4-75d8-4b22-a7d0-7a9461888144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defe34ff-0ec5-45f8-8ed7-66558d352406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:05 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Volume 0151b20c-be3e-49d7-9c36-f801f6e4d4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1', 'volume_size': 1} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-322025988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0151b20c-be3e-49d7-9c36-f801f6e4d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:05Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Creating volume 0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:05 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:05 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 1073741824 Apr 01 08:13:05 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:05 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 1073741824" returned: 0 in 0.438s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:05 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:05 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:06 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defe34ff-0ec5-45f8-8ed7-66558d352406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2606d438-184b-4dc6-88d3-41ba01b1326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:06 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Volume volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 (0151b20c-be3e-49d7-9c36-f801f6e4d4e1): created successfully Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2606d438-184b-4dc6-88d3-41ba01b1326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (9a0eb80c-3d8d-4050-a44e-ac0678981694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c7d15b8c-7ad5-4c35-8f28-d3eaf609b236 tempest-VolumesSnapshotTestJSON-27808219 None] Created volume successfully. Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Creating offline snapshot 5e0cc070-a5e6-4c0c-9a1c-723c40daf531 of volume 0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76363c-3f81-4f47-a30d-69f3a66e81ef]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:06 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:06 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:06 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:06 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 1G Apr 01 08:13:06 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:07 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 1G" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:07 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:07 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:07 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.389s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:07 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 is being set with open permissions: ugo+rw Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:07 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:07 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:07 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:07 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info Apr 01 08:13:07 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:08 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info" returned: 0 in 0.409s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:08 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info is being set with open permissions: ugo+rw Apr 01 08:13:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:08 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info Apr 01 08:13:08 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:08 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.info" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:08 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-b7f06da4-3def-4160-8017-6cbd975e2a3b tempest-VolumesSnapshotTestJSON-27808219 None] Create snapshot completed successfully Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (9d08415a-de70-4d6d-ab5c-c8d5178245ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457d34b-dd33-4485-bf0b-8932038aa79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457d34b-dd33-4485-bf0b-8932038aa79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1471652397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76b5de5-61d2-4aa0-9aa9-0c756d9f1003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5e0cc070-a5e6-4c0c-9a1c-723c40daf531,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:10Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784847f4-81f5-483c-ba0d-a24231a5dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784847f4-81f5-483c-ba0d-a24231a5dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4bb7fd-682b-401f-9e79-a5590fe1f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4bb7fd-682b-401f-9e79-a5590fe1f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e76b5de5-61d2-4aa0-9aa9-0c756d9f1003', 'volume_name': 'volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003', 'volume_size': 2, 'snapshot_id': '5e0cc070-a5e6-4c0c-9a1c-723c40daf531'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc076b6c-779d-4eb8-bb79-12f39d3b37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc076b6c-779d-4eb8-bb79-12f39d3b37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb68cca-cc11-492f-ad1b-f68b1b853b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:09 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Volume e76b5de5-61d2-4aa0-9aa9-0c756d9f1003: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003', 'volume_size': 2, 'snapshot_id': '5e0cc070-a5e6-4c0c-9a1c-723c40daf531'} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Creating volume e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 from snapshot 5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] snapshot: 5e0cc070-a5e6-4c0c-9a1c-723c40daf531, volume: e76b5de5-61d2-4aa0-9aa9-0c756d9f1003, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6326a7f-f8e3-434f-b2a9-75ef888c3ffe]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:09 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:09 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:10 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.448s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec413f2-c5d5-40ee-853c-f539f43608e5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:10 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:10 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:10 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:13:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:10 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 Apr 01 08:13:10 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:12 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" returned: 0 in 1.664s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[305bd253-4747-4fed-b4da-104fbee96a39]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:12 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:12 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:12 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.544s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1, size 1024.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:13:12 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Converted 1024.00 MB image at 614.66 MB/s Apr 01 08:13:12 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 is being set with open permissions: ugo+rw Apr 01 08:13:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:12 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 Apr 01 08:13:12 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:13 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" returned: 0 in 0.377s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" released by "_copy_volume_from_snapshot" :: held 3.518s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" released by "_create_volume_from_snapshot" :: held 3.537s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.545s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb68cca-cc11-492f-ad1b-f68b1b853b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003', 'volume_size': 2, 'snapshot_id': '5e0cc070-a5e6-4c0c-9a1c-723c40daf531'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b0b68-c6e7-48ce-a6f4-354187d081d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Volume volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 (e76b5de5-61d2-4aa0-9aa9-0c756d9f1003): created successfully Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b0b68-c6e7-48ce-a6f4-354187d081d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (9d08415a-de70-4d6d-ab5c-c8d5178245ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-86b55f90-c89c-4e43-aac4-1d9bf374b6dc tempest-VolumesSnapshotTestJSON-27808219 None] Created volume successfully. Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e84cfd-08ea-4887-8942-2f499a793ffc]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:14 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 Apr 01 08:13:14 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:14 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" returned: 0 in 0.445s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:14 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003 Apr 01 08:13:14 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:14 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003" released by "delete_volume" :: held 0.839s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['e7528069-11cc-4184-a42d-bfcd412fac2c', '356e8e8d-53aa-4a04-9f79-b22c7175f5ed', 'e0af5776-f96b-4411-a451-113f9d25ea76', 'b601b2de-3126-41e2-8ac8-a3df2131fa8c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:14 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:14 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Deleting offline snapshot 5e0cc070-a5e6-4c0c-9a1c-723c40daf531 of volume 0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] snapshot_file for this snap is: volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c750ce-7d93-42f3-a3e8-7ab33d7838c6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:15 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:15 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:15 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.407s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Deleted volume successfully. Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e2d6d299-6860-45f6-be1e-c716946386e8 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-e76b5de5-61d2-4aa0-9aa9-0c756d9f1003-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:15 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.457s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f95da9-3d15-4f56-bb76-c43bfe663bf8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:15 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:15 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:16 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:16 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:16 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:16 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:16 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531 Apr 01 08:13:16 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:16 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1.5e0cc070-a5e6-4c0c-9a1c-723c40daf531" returned: 0 in 0.386s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-5e0cc070-a5e6-4c0c-9a1c-723c40daf531" released by "_delete_snapshot" :: held 1.758s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" released by "delete_snapshot" :: held 1.769s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['54e04a30-184b-4cb4-9afc-f8824644db3b', '06a74c76-a6d5-4b9b-95e9-76d11d104ecb', '9f663a82-d957-43d2-80c9-a69c24c87351', 'd779244f-1e34-421d-95e2-a2f091558a9b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:16 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Delete snapshot completed successfully. Apr 01 08:13:16 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7ffb1fad-adf3-468a-8abe-2f0bf31dd92c tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-5e0cc070-a5e6-4c0c-9a1c-723c40daf531-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-0151b20c-be3e-49d7-9c36-f801f6e4d4e1-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-0151b20c-be3e-49d7-9c36-f801f6e4d4e1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6c6ed-94de-4860-98d0-a5df5c6fb5de]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:17 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:17 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:17 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:17 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1 Apr 01 08:13:17 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:18 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0151b20c-be3e-49d7-9c36-f801f6e4d4e1" released by "delete_volume" :: held 0.866s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['bd0a3d74-ce54-47af-b0db-4544584f06d0', '72d59079-68d6-4c8e-80c5-619187658020', 'a25e6ebb-4935-4922-9155-fa8fb67ac85e', 'f07ed742-e720-4397-a3d4-79d1700982b4'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:18 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:18 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (e8de5fbe-1325-4d26-9059-e39d4f310534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf52765-c868-420e-9297-22f183b3549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf52765-c868-420e-9297-22f183b3549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-57605016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b1f2cf-63ef-4f8b-8b3b-847841979cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:19Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:18 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d9ec9-4040-468f-9a43-2a5d4e5eee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d9ec9-4040-468f-9a43-2a5d4e5eee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729fdf56-1c78-40b9-89f9-5beb30845c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729fdf56-1c78-40b9-89f9-5beb30845c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b1f2cf-63ef-4f8b-8b3b-847841979cca', 'volume_name': 'volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6b7c11-b5db-4b15-9069-f9ba694a51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6b7c11-b5db-4b15-9069-f9ba694a51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca7434c-0208-431e-850f-c3db2f1bc4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:18 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Volume 64b1f2cf-63ef-4f8b-8b3b-847841979cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca', 'volume_size': 1} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-57605016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b1f2cf-63ef-4f8b-8b3b-847841979cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:19Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Creating volume 64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:18 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.476s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Deleted volume successfully. Apr 01 08:13:18 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca 1073741824 Apr 01 08:13:18 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:18 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-09743feb-3ea6-40ba-ae6a-a2cb951e5383 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-0151b20c-be3e-49d7-9c36-f801f6e4d4e1-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:19 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca 1073741824" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:19 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:19 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:19 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca7434c-0208-431e-850f-c3db2f1bc4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49af5e78-583e-4a6a-ac46-2b94a1ff6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Volume volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca (64b1f2cf-63ef-4f8b-8b3b-847841979cca): created successfully Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49af5e78-583e-4a6a-ac46-2b94a1ff6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (e8de5fbe-1325-4d26-9059-e39d4f310534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-734d51a2-573b-4b2e-8b0d-58fa64ec8315 tempest-VolumesSnapshotTestJSON-27808219 None] Created volume successfully. Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Creating offline snapshot 0d07823c-8868-4ef0-adf3-9f329ac81859 of volume 64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1233d3-94b5-4b6e-9946-60146b79d3b8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:19 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:19 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:20 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:20 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 1G Apr 01 08:13:20 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:20 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 1G" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:20 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:20 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:21 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:21 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 is being set with open permissions: ugo+rw Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:21 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:21 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:21 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:21 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info Apr 01 08:13:21 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:21 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info" returned: 0 in 0.371s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:21 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info is being set with open permissions: ugo+rw Apr 01 08:13:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:21 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info Apr 01 08:13:21 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:22 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.info" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:22 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3e29f367-1f9a-4f31-9f33-05f743f9f764 tempest-VolumesSnapshotTestJSON-27808219 None] Create snapshot completed successfully Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (3f227609-92f5-4a3c-91df-d98c1dea4682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845cbcf2-238d-4bc7-a2e5-f529c38f266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845cbcf2-238d-4bc7-a2e5-f529c38f266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1864848483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eaae24-b994-40f3-b7bc-84c429213091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c83c0ec2e9a64c049fa224a76233b061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d07823c-8868-4ef0-adf3-9f329ac81859,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:23Z,use_quota=True,user_id='70bfd854d1444773b6cd443bb2089566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba532dd-8b6f-4ecb-be5f-56937d7674d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba532dd-8b6f-4ecb-be5f-56937d7674d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d6fc34-38d7-429a-aa1d-073dbc7fed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d6fc34-38d7-429a-aa1d-073dbc7fed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6eaae24-b994-40f3-b7bc-84c429213091', 'volume_name': 'volume-a6eaae24-b994-40f3-b7bc-84c429213091', 'volume_size': 1, 'snapshot_id': '0d07823c-8868-4ef0-adf3-9f329ac81859'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d66a72-beff-4ddb-9a05-f80030ade0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d66a72-beff-4ddb-9a05-f80030ade0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115dd01b-70c6-4e41-a4cd-8784908cd4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:23 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Volume a6eaae24-b994-40f3-b7bc-84c429213091: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6eaae24-b994-40f3-b7bc-84c429213091', 'volume_size': 1, 'snapshot_id': '0d07823c-8868-4ef0-adf3-9f329ac81859'} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859-a6eaae24-b994-40f3-b7bc-84c429213091" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859-a6eaae24-b994-40f3-b7bc-84c429213091" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Creating volume a6eaae24-b994-40f3-b7bc-84c429213091 from snapshot 0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] snapshot: 0d07823c-8868-4ef0-adf3-9f329ac81859, volume: a6eaae24-b994-40f3-b7bc-84c429213091, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0001042-1a06-477a-848d-d97557e00731]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:23 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:23 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:23 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95269c6-6e2f-4ea1-85b1-54cf9b360275]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:23 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:23 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:24 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:24 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:13:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:24 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 Apr 01 08:13:24 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:25 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091" returned: 0 in 1.683s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:25 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[89688a27-0d58-47d1-9773-fa331cb45461]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:25 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:25 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:26 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.563s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca, size 1024.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:13:26 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Converted 1024.00 MB image at 608.15 MB/s Apr 01 08:13:26 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 is being set with open permissions: ugo+rw Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:26 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 Apr 01 08:13:26 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:26 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091" returned: 0 in 0.371s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" released by "_copy_volume_from_snapshot" :: held 3.581s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859-a6eaae24-b994-40f3-b7bc-84c429213091" released by "_create_volume_from_snapshot" :: held 3.597s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.603s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115dd01b-70c6-4e41-a4cd-8784908cd4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6eaae24-b994-40f3-b7bc-84c429213091', 'volume_size': 1, 'snapshot_id': '0d07823c-8868-4ef0-adf3-9f329ac81859'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb9f7d5-897e-494b-b602-8f2768b6fe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:26 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Volume volume-a6eaae24-b994-40f3-b7bc-84c429213091 (a6eaae24-b994-40f3-b7bc-84c429213091): created successfully Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb9f7d5-897e-494b-b602-8f2768b6fe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Flow 'volume_create_manager' (3f227609-92f5-4a3c-91df-d98c1dea4682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-24d04646-1d25-4a9e-8b3a-3788055f2144 tempest-VolumesSnapshotTestJSON-27808219 None] Created volume successfully. Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-a6eaae24-b994-40f3-b7bc-84c429213091-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-a6eaae24-b994-40f3-b7bc-84c429213091-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c659948-0faf-4323-a455-52a1534dbcde]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:27 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 Apr 01 08:13:27 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:27 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:27 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091 Apr 01 08:13:27 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:28 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-a6eaae24-b994-40f3-b7bc-84c429213091" returned: 0 in 0.393s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-a6eaae24-b994-40f3-b7bc-84c429213091" released by "delete_volume" :: held 0.867s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['738e88c9-7c20-4038-b915-ed0261923dd6', '18996219-4e75-4b43-a46e-77e95956421c', 'f94e6119-36dc-464b-9ba5-9ba9752879b9', 'cd0362e0-c088-46c3-8f8c-6bcf716ce2a0'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:28 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:28 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-0d07823c-8868-4ef0-adf3-9f329ac81859-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-0d07823c-8868-4ef0-adf3-9f329ac81859-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Deleting offline snapshot 0d07823c-8868-4ef0-adf3-9f329ac81859 of volume 64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] snapshot_file for this snap is: volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[296d90fb-c15b-4156-9b1d-4f4682cd68bc]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:28 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:28 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:28 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.406s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:28 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Deleted volume successfully. Apr 01 08:13:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6dbcd71f-575e-4711-b0ed-f7bdd0b4265f tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-a6eaae24-b994-40f3-b7bc-84c429213091-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:29 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[729aff30-0c82-403c-86c3-8b2595d987a9]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:29 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:29 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:29 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:29 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:29 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:29 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:29 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859 Apr 01 08:13:29 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:30 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca.0d07823c-8868-4ef0-adf3-9f329ac81859" returned: 0 in 0.375s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-0d07823c-8868-4ef0-adf3-9f329ac81859" released by "_delete_snapshot" :: held 1.705s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" released by "delete_snapshot" :: held 1.716s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['8ccfc089-d146-4f59-8014-12fa6604a37e', '8ce875f6-12ec-4c59-b25b-09e4a305c632', '90e23f0f-dc3e-4ada-9cee-20efae1a4362', '1c7f7a1f-044e-42ec-95e5-baab7df803ea'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Delete snapshot completed successfully. Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-4e942a02-bfb1-43eb-9ef6-37d6102e293e tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-0d07823c-8868-4ef0-adf3-9f329ac81859-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-64b1f2cf-63ef-4f8b-8b3b-847841979cca-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-64b1f2cf-63ef-4f8b-8b3b-847841979cca-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320ef57-b8a6-4520-900f-72bb6bd86b23]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:30 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:30 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:31 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:31 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca Apr 01 08:13:31 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:31 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-64b1f2cf-63ef-4f8b-8b3b-847841979cca" returned: 0 in 0.368s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-64b1f2cf-63ef-4f8b-8b3b-847841979cca" released by "delete_volume" :: held 0.827s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['7bb55855-2a85-4818-af8a-151babde7803', '4d20989f-e59f-483d-ae50-4022f25af66d', '1a51529b-f751-4ee5-83a6-97fa17568656', '922be0ef-6776-4eb4-8af1-2710298004d2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:31 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:31 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-7edb1d95-89d9-479b-9fb4-bbd759f6ce12-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-7edb1d95-89d9-479b-9fb4-bbd759f6ce12-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e058f0-6088-4b7b-b17e-496fdb766a55]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:32 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 Apr 01 08:13:32 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:32 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.395s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Deleted volume successfully. Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5026ffb-aad1-443e-9473-17928a8a5108 tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-64b1f2cf-63ef-4f8b-8b3b-847841979cca-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:32 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:32 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12 Apr 01 08:13:32 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:32 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" returned: 0 in 0.363s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-quobyte-7edb1d95-89d9-479b-9fb4-bbd759f6ce12" released by "delete_volume" :: held 0.838s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Created reservations ['f666604e-27af-4824-836f-c9c044ec380c', 'd7e0e8e1-c000-41ba-9a3f-7d33dd71e2e2', '0199c258-6eb5-4f26-b28a-801788a6b45d', '5dbb8efb-db3e-47de-8f49-2882863b58a6'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:32 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:32 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:33 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.396s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:33 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:33 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Deleted volume successfully. Apr 01 08:13:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-2a28dab3-0d69-4137-9470-0166926af06d tempest-VolumesSnapshotTestJSON-27808219 None] Lock "cinder-7edb1d95-89d9-479b-9fb4-bbd759f6ce12-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (fe5d1886-edbe-4a13-ba36-7d6900856f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2d49a2-10f7-40f2-9286-02ed04dc7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2d49a2-10f7-40f2-9286-02ed04dc7c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302034323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43124e5a-bfbb-4264-8f1f-372aa969f3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:37Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee27be6-fa91-4bae-8a38-90ec206e30b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee27be6-fa91-4bae-8a38-90ec206e30b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20353170-12e0-4163-a08d-c1dc8297938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20353170-12e0-4163-a08d-c1dc8297938c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43124e5a-bfbb-4264-8f1f-372aa969f3c1', 'volume_name': 'volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4357ff63-5f7d-47a2-a629-ea93c0bb37b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4357ff63-5f7d-47a2-a629-ea93c0bb37b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30496b32-f9f6-460f-af57-d5bc08b39611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:36 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume 43124e5a-bfbb-4264-8f1f-372aa969f3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1', 'volume_size': 1} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302034323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43124e5a-bfbb-4264-8f1f-372aa969f3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:37Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume 43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:36 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:36 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 1073741824 Apr 01 08:13:36 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:37 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 1073741824" returned: 0 in 0.480s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:37 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 Apr 01 08:13:37 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:37 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1" returned: 0 in 0.373s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30496b32-f9f6-460f-af57-d5bc08b39611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a36d118-3ae8-4877-a12c-23d11ffc30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:37 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 (43124e5a-bfbb-4264-8f1f-372aa969f3c1): created successfully Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a36d118-3ae8-4877-a12c-23d11ffc30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (fe5d1886-edbe-4a13-ba36-7d6900856f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:37 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-eb3afddf-ee99-4764-a810-c6c46000d8a2 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating offline snapshot 6c956203-9a26-4b8d-8d51-336cb5ae7358 of volume 43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cd8862-3ebf-4dee-971e-6f278ae31405]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:37 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 Apr 01 08:13:37 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:38 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:38 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 1G Apr 01 08:13:38 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:38 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 1G" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:38 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 Apr 01 08:13:38 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:39 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358" returned: 0 in 0.400s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:39 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 is being set with open permissions: ugo+rw Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:39 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 Apr 01 08:13:39 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:39 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:39 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info Apr 01 08:13:39 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:39 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info" returned: 0 in 0.374s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:39 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info is being set with open permissions: ugo+rw Apr 01 08:13:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:39 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info Apr 01 08:13:39 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:40 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.info" returned: 0 in 0.390s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-463a541e-673f-43c4-85fc-8442f03c326a tempest-CreateVolumesFromSnapshotTest-2099827882 None] Create snapshot completed successfully Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (061e8f6c-fe3d-465d-8550-c4b9733f00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f124244-4c99-4fe6-a88e-d5acbbc172c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f124244-4c99-4fe6-a88e-d5acbbc172c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723079853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f29f25-3bb4-4d87-ae6f-d3a3d87648c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:41Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649be225-d711-4e71-be2a-6c8a91468413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649be225-d711-4e71-be2a-6c8a91468413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f39607-2b4e-42d3-8e03-e71f89651705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f39607-2b4e-42d3-8e03-e71f89651705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f29f25-3bb4-4d87-ae6f-d3a3d87648c4', 'volume_name': 'volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f83ef90-136e-412a-a5e9-6ea70bb44969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f83ef90-136e-412a-a5e9-6ea70bb44969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947c2148-930f-463f-acfd-a0ccdd169abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume 60f29f25-3bb4-4d87-ae6f-d3a3d87648c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4', 'volume_size': 1} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723079853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f29f25-3bb4-4d87-ae6f-d3a3d87648c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:41Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume 60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:41 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 1073741824 Apr 01 08:13:41 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (f199b45c-08ce-4e74-9ec2-8edbece519d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8568466-925f-44c7-b3dc-43822d5b3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8568466-925f-44c7-b3dc-43822d5b3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084957428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bce8784-53f2-4589-8fc7-cbb30bd82242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:41Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396c1600-ffb8-4b76-95bf-6e4adebfb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396c1600-ffb8-4b76-95bf-6e4adebfb504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ea4f4a-5a01-49d2-9a00-c0fbf6e766aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ea4f4a-5a01-49d2-9a00-c0fbf6e766aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bce8784-53f2-4589-8fc7-cbb30bd82242', 'volume_name': 'volume-0bce8784-53f2-4589-8fc7-cbb30bd82242', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b5836-6f1a-4934-b1d7-ed641c87afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338b5836-6f1a-4934-b1d7-ed641c87afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c904c816-c3a7-4cc9-a324-fef3dc081508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume 0bce8784-53f2-4589-8fc7-cbb30bd82242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bce8784-53f2-4589-8fc7-cbb30bd82242', 'volume_size': 1} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (beea7921-9e19-46f3-bce6-755864852fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b732e-d56f-46dd-971e-6f8097da0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b732e-d56f-46dd-971e-6f8097da0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807973846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8abb1a-a8c9-486c-bc50-5122290f0964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb25f3e-1b5f-48b6-a7eb-7cfeaf0258e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb25f3e-1b5f-48b6-a7eb-7cfeaf0258e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ef1ebb-c0b1-425e-a9b2-fc315a9760c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ef1ebb-c0b1-425e-a9b2-fc315a9760c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8abb1a-a8c9-486c-bc50-5122290f0964', 'volume_name': 'volume-0b8abb1a-a8c9-486c-bc50-5122290f0964', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13412303-f9bf-48bc-ae95-2721dfd516b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13412303-f9bf-48bc-ae95-2721dfd516b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3fd74db-243e-4f28-ba32-d00b6904f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume 0b8abb1a-a8c9-486c-bc50-5122290f0964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8abb1a-a8c9-486c-bc50-5122290f0964', 'volume_size': 1} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (e56bacaa-5997-4cb3-922c-e4c26dbe9f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920c67cc-0aa1-4557-9c63-5c9bb0d765c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920c67cc-0aa1-4557-9c63-5c9bb0d765c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721084844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a7952-cd15-462c-b00d-346aab95b1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f98a8-c6b7-4013-ba09-25ff273ea197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f98a8-c6b7-4013-ba09-25ff273ea197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafe37ad-58e3-4fca-b52b-c035b15b732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafe37ad-58e3-4fca-b52b-c035b15b732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629a7952-cd15-462c-b00d-346aab95b1a5', 'volume_name': 'volume-629a7952-cd15-462c-b00d-346aab95b1a5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7b6d2d-9fb9-4fb8-be47-bb2966eaef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7b6d2d-9fb9-4fb8-be47-bb2966eaef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495b9687-1666-42f8-a4c8-0b5048c9f5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume 629a7952-cd15-462c-b00d-346aab95b1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629a7952-cd15-462c-b00d-346aab95b1a5', 'volume_size': 1} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 1073741824" returned: 0 in 0.588s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:41 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 Apr 01 08:13:41 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (7b00ee0f-9fc6-40e8-9500-0e1e7f3e80d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467d3430-dcae-4ad2-bdc9-76a80ade09ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467d3430-dcae-4ad2-bdc9-76a80ade09ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1518297900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188049c-f63b-4ca3-ab45-ed2e3ae3df90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7633e2e5-27be-479d-96e9-31e70d825394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7633e2e5-27be-479d-96e9-31e70d825394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff015cdc-b6e4-4a4e-8a16-566eeea07810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff015cdc-b6e4-4a4e-8a16-566eeea07810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c188049c-f63b-4ca3-ab45-ed2e3ae3df90', 'volume_name': 'volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad8a3d-0a89-40e5-ae61-573ab12155e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad8a3d-0a89-40e5-ae61-573ab12155e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc7e3b-654f-4376-bdba-d39b0d2c814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:41 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume c188049c-f63b-4ca3-ab45-ed2e3ae3df90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90', 'volume_size': 1} Apr 01 08:13:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:42 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" returned: 0 in 0.403s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084957428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bce8784-53f2-4589-8fc7-cbb30bd82242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:41Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume 0bce8784-53f2-4589-8fc7-cbb30bd82242 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:42 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947c2148-930f-463f-acfd-a0ccdd169abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a385316-d406-4385-9d95-cd6bbf196810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:42 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 1073741824 Apr 01 08:13:42 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 (60f29f25-3bb4-4d87-ae6f-d3a3d87648c4): created successfully Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a385316-d406-4385-9d95-cd6bbf196810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (061e8f6c-fe3d-465d-8550-c4b9733f00d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:42 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-4c92b277-1474-471f-8684-11e99092cd7e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:42 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 1073741824" returned: 0 in 0.478s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:42 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 Apr 01 08:13:42 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:43 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807973846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8abb1a-a8c9-486c-bc50-5122290f0964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume 0b8abb1a-a8c9-486c-bc50-5122290f0964 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:43 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c904c816-c3a7-4cc9-a324-fef3dc081508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bce8784-53f2-4589-8fc7-cbb30bd82242', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:43 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 1073741824 Apr 01 08:13:43 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dab4520-0ba5-4e2c-8a39-ececbb50d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 (0bce8784-53f2-4589-8fc7-cbb30bd82242): created successfully Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dab4520-0ba5-4e2c-8a39-ececbb50d417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (f199b45c-08ce-4e74-9ec2-8edbece519d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:43 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-959c6caa-29e6-4e95-b0fd-c42989549729 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:43 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 1073741824" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:43 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 Apr 01 08:13:43 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:43 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964" returned: 0 in 0.364s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.186s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721084844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629a7952-cd15-462c-b00d-346aab95b1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume 629a7952-cd15-462c-b00d-346aab95b1a5 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:43 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3fd74db-243e-4f28-ba32-d00b6904f381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8abb1a-a8c9-486c-bc50-5122290f0964', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b62ff26-d7aa-47f2-a70a-4a1951ba8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:44 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 1073741824 Apr 01 08:13:44 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 (0b8abb1a-a8c9-486c-bc50-5122290f0964): created successfully Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b62ff26-d7aa-47f2-a70a-4a1951ba8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (beea7921-9e19-46f3-bce6-755864852fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-367fb4b3-e6f0-429a-9403-74030f28986b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:44 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 1073741824" returned: 0 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:44 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 Apr 01 08:13:44 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:44 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5" returned: 0 in 0.357s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1518297900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188049c-f63b-4ca3-ab45-ed2e3ae3df90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e6a2a1fa2c4e49af2407aa98a1e071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:42Z,use_quota=True,user_id='e220b957740a4c8a90d1a90e2f9b8ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Creating volume c188049c-f63b-4ca3-ab45-ed2e3ae3df90 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:44 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495b9687-1666-42f8-a4c8-0b5048c9f5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629a7952-cd15-462c-b00d-346aab95b1a5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:44 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 1073741824 Apr 01 08:13:44 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218b95b-f231-40b5-9968-76067b1e94fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-629a7952-cd15-462c-b00d-346aab95b1a5 (629a7952-cd15-462c-b00d-346aab95b1a5): created successfully Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218b95b-f231-40b5-9968-76067b1e94fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (e56bacaa-5997-4cb3-922c-e4c26dbe9f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:44 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-353cf052-9fc1-4c13-bdb8-27b500c8f1fc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:45 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 1073741824" returned: 0 in 0.452s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:45 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 Apr 01 08:13:45 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:45 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" returned: 0 in 0.360s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc7e3b-654f-4376-bdba-d39b0d2c814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b3fb9-5357-4902-b9b1-acd67e48af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:45 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Volume volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 (c188049c-f63b-4ca3-ab45-ed2e3ae3df90): created successfully Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b3fb9-5357-4902-b9b1-acd67e48af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Flow 'volume_create_manager' (7b00ee0f-9fc6-40e8-9500-0e1e7f3e80d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f2218a2e-6aff-4769-b194-86342e4e3273 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created volume successfully. Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-c188049c-f63b-4ca3-ab45-ed2e3ae3df90-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-c188049c-f63b-4ca3-ab45-ed2e3ae3df90-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=88,cinder:INSERT=23,cinder:UPDATE=101,cinder:DELETE=12 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=93,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=9 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f658144-433d-4280-a291-d095e8ef86ea]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:46 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 Apr 01 08:13:46 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:46 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" returned: 0 in 0.420s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:46 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90 Apr 01 08:13:46 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:47 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" returned: 0 in 0.372s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-c188049c-f63b-4ca3-ab45-ed2e3ae3df90" released by "delete_volume" :: held 0.812s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['5279603a-cf54-447a-9182-ae06edc21f88', '25d5e124-9f43-477e-9f7d-3475fddc8dac', 'a9272382-9472-4eef-b609-23113901d829', '55092a58-2f04-45bd-aca4-973a8338df1e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:47 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:47 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-629a7952-cd15-462c-b00d-346aab95b1a5-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-629a7952-cd15-462c-b00d-346aab95b1a5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-629a7952-cd15-462c-b00d-346aab95b1a5" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-629a7952-cd15-462c-b00d-346aab95b1a5" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b222d8bd-8617-473d-857f-9c7adf3ca72a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:47 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 Apr 01 08:13:47 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:47 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:47 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3ff556b2-4d00-47df-8de6-500b71507d8b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-c188049c-f63b-4ca3-ab45-ed2e3ae3df90-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:47 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5" returned: 0 in 0.443s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:47 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5 Apr 01 08:13:47 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:48 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-629a7952-cd15-462c-b00d-346aab95b1a5" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-629a7952-cd15-462c-b00d-346aab95b1a5" released by "delete_volume" :: held 0.848s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['eb743f66-e09d-4951-bb41-1e74b1311ee2', '30db0258-c941-4212-99b9-af1719afda4f', '2bf974fe-7920-41a6-8734-762805a864ec', '9132f107-a9c6-498c-83cf-5377d102f938'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:48 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:48 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-0b8abb1a-a8c9-486c-bc50-5122290f0964-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-0b8abb1a-a8c9-486c-bc50-5122290f0964-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-0b8abb1a-a8c9-486c-bc50-5122290f0964" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-0b8abb1a-a8c9-486c-bc50-5122290f0964" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773da11-7e4a-408c-8174-da3635a9e75f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:48 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 Apr 01 08:13:48 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:48 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.401s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31200596-c899-4008-85ae-48a8f117595e tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-629a7952-cd15-462c-b00d-346aab95b1a5-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:49 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964" returned: 0 in 0.446s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:49 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964 Apr 01 08:13:49 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:49 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0b8abb1a-a8c9-486c-bc50-5122290f0964" returned: 0 in 0.380s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-0b8abb1a-a8c9-486c-bc50-5122290f0964" released by "delete_volume" :: held 0.847s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['01b75307-7792-410f-88f1-9cdd2584b4c6', 'ed618886-b4e3-4c88-b651-a23fe9cc358f', 'c03d41ea-e5ec-4c72-a89c-e6f194e204f3', '81067953-e1e9-4e9e-b03d-e2099520427e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:49 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:49 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-0bce8784-53f2-4589-8fc7-cbb30bd82242-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-0bce8784-53f2-4589-8fc7-cbb30bd82242-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-0bce8784-53f2-4589-8fc7-cbb30bd82242" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-0bce8784-53f2-4589-8fc7-cbb30bd82242" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ab414-3906-4440-9439-8f2f45158221]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:49 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 Apr 01 08:13:49 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:49 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.395s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-0244967f-62ee-4e24-b3aa-f309aab2ed09 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-0b8abb1a-a8c9-486c-bc50-5122290f0964-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:50 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242" returned: 0 in 0.429s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:50 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242 Apr 01 08:13:50 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:50 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-0bce8784-53f2-4589-8fc7-cbb30bd82242" returned: 0 in 0.358s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-0bce8784-53f2-4589-8fc7-cbb30bd82242" released by "delete_volume" :: held 0.807s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['61a1e9ca-e176-4d67-9752-c737425d5692', '9f4b3a9d-7ad1-4a51-8d78-ebe6b0d0f213', 'c42013c8-c956-4617-861a-2ed2137aaf7f', '67e8bc4b-6872-4f33-9ce6-fb63e81ff501'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:50 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:50 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af8e2e4-f0d5-4205-ba26-b5bd116d95c4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:50 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 Apr 01 08:13:50 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:50 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.409s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-612a50ea-bb88-4019-95b5-87ef2fc02edc tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-0bce8784-53f2-4589-8fc7-cbb30bd82242-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:51 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" returned: 0 in 0.437s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:51 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4 Apr 01 08:13:51 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:51 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" returned: 0 in 0.373s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4" released by "delete_volume" :: held 0.830s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['59db5b3a-1d71-456b-b65d-5ef3464c9b23', '282d29ac-82d4-47ab-976e-af4db0a47a4e', '316214c7-5655-4e50-8fee-8e3740fe0f53', '66b46652-0969-414d-b879-03ddbfb2ccfb'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:51 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:51 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-6c956203-9a26-4b8d-8d51-336cb5ae7358-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-6c956203-9a26-4b8d-8d51-336cb5ae7358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-6c956203-9a26-4b8d-8d51-336cb5ae7358" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-6c956203-9a26-4b8d-8d51-336cb5ae7358" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleting offline snapshot 6c956203-9a26-4b8d-8d51-336cb5ae7358 of volume 43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] snapshot_file for this snap is: volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c1717-8c54-400f-bef5-133d7dbb9702]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:51 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 Apr 01 08:13:51 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:52 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.403s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:52 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d9f75cdb-ca36-4710-97fc-79bd48b87277 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-60f29f25-3bb4-4d87-ae6f-d3a3d87648c4-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:52 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358" returned: 0 in 0.433s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74f20b-3450-4b2e-ba1d-698bbf96def9]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:52 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 Apr 01 08:13:52 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:52 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1" returned: 0 in 0.417s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:52 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 Apr 01 08:13:52 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:53 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358" returned: 0 in 0.420s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:53 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358 Apr 01 08:13:53 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:53 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1.6c956203-9a26-4b8d-8d51-336cb5ae7358" returned: 0 in 0.364s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-6c956203-9a26-4b8d-8d51-336cb5ae7358" released by "_delete_snapshot" :: held 1.683s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" released by "delete_snapshot" :: held 1.693s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['6a62ad68-0bd5-41ee-8c09-392f869f772f', '24c95dfd-14a7-4e16-9687-100948a37e23', '4dce699f-896d-4d68-b8ec-50ecf56ceb68', 'c18aedc7-2cc9-439f-8a35-962c274d3e2d'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Delete snapshot completed successfully. Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c5f8bb19-0757-435c-8a39-5616e932506b tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-6c956203-9a26-4b8d-8d51-336cb5ae7358-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-43124e5a-bfbb-4264-8f1f-372aa969f3c1-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-43124e5a-bfbb-4264-8f1f-372aa969f3c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:13:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[98423b0f-e500-4d6d-8d59-efb3b15f79d7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:54 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 Apr 01 08:13:54 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:54 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:54 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1 Apr 01 08:13:54 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:54 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-43124e5a-bfbb-4264-8f1f-372aa969f3c1" returned: 0 in 0.357s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-quobyte-43124e5a-bfbb-4264-8f1f-372aa969f3c1" released by "delete_volume" :: held 0.809s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Created reservations ['97f6f5a6-d602-42d4-bc85-9c532479aa88', '5e7956f6-2223-44de-b85a-bc4aaa434aee', 'bf90f16f-586c-4f58-9878-865dd104f599', '80d1365e-b161-4620-b100-4fc980c861f8'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:54 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:54 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:55 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.414s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Deleted volume successfully. Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d2cfeab9-3af2-44e4-a235-143f72e57c17 tempest-CreateVolumesFromSnapshotTest-2099827882 None] Lock "cinder-43124e5a-bfbb-4264-8f1f-372aa969f3c1-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:55 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:13:55 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:56 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Flow 'volume_create_manager' (033afd94-9288-407b-8158-05caaa91b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adadd0c-9226-4917-abbf-7a26e17fc9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adadd0c-9226-4917-abbf-7a26e17fc9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993c7b9a-9b67-4814-9202-e68af11c6fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dac747a0dfd442cad3080c603bcb64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:57Z,use_quota=True,user_id='d2b8a30c73534c63956da649e522ea72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162aad6b-6c93-4797-8606-a9ba00201d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162aad6b-6c93-4797-8606-a9ba00201d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada93f16-9908-4dd3-bcbc-45f7206079c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada93f16-9908-4dd3-bcbc-45f7206079c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993c7b9a-9b67-4814-9202-e68af11c6fbb', 'volume_name': 'volume-993c7b9a-9b67-4814-9202-e68af11c6fbb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfcec14-448f-4f04-9d76-c08b396043b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfcec14-448f-4f04-9d76-c08b396043b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb16bfd-10e5-46b6-add6-f28cd2cfdc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:56 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Volume 993c7b9a-9b67-4814-9202-e68af11c6fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993c7b9a-9b67-4814-9202-e68af11c6fbb', 'volume_size': 1} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993c7b9a-9b67-4814-9202-e68af11c6fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dac747a0dfd442cad3080c603bcb64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:57Z,use_quota=True,user_id='d2b8a30c73534c63956da649e522ea72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Creating volume 993c7b9a-9b67-4814-9202-e68af11c6fbb {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:56 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:56 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb 1073741824 Apr 01 08:13:56 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:57 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb 1073741824" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:57 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb Apr 01 08:13:57 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:57 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb16bfd-10e5-46b6-add6-f28cd2cfdc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993c7b9a-9b67-4814-9202-e68af11c6fbb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dd7320-af3e-4fa6-b216-ef96006fab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Volume volume-993c7b9a-9b67-4814-9202-e68af11c6fbb (993c7b9a-9b67-4814-9202-e68af11c6fbb): created successfully Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dd7320-af3e-4fa6-b216-ef96006fab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Flow 'volume_create_manager' (033afd94-9288-407b-8158-05caaa91b31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:57 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-aef2dfd2-b90a-4fe8-b2d7-4d9c610e1ba4 tempest-CinderUnicodeTest-568864871 None] Created volume successfully. Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Flow 'volume_create_manager' (19703f7f-82cb-4b56-869d-774b84c8efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c42266-8a57-4058-9025-16996b1c48f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c42266-8a57-4058-9025-16996b1c48f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-481602394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ae26fe-6d5f-4d95-b738-0c50292ee0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dac747a0dfd442cad3080c603bcb64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:58Z,use_quota=True,user_id='d2b8a30c73534c63956da649e522ea72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a7ce2-cdda-458f-a253-17ff0ce17fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a7ce2-cdda-458f-a253-17ff0ce17fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538f6ba-1664-498f-a7f2-f937d4d2e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538f6ba-1664-498f-a7f2-f937d4d2e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ae26fe-6d5f-4d95-b738-0c50292ee0f0', 'volume_name': 'volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d29e40-6790-4c44-808b-505dffd73807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d29e40-6790-4c44-808b-505dffd73807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e1ad75-2e4f-4976-a2a9-e7d5867437df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:57 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Volume 59ae26fe-6d5f-4d95-b738-0c50292ee0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0', 'volume_size': 1} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:13:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-481602394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ae26fe-6d5f-4d95-b738-0c50292ee0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dac747a0dfd442cad3080c603bcb64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:13:58Z,use_quota=True,user_id='d2b8a30c73534c63956da649e522ea72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Creating volume 59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:13:57 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:13:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:57 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 1073741824 Apr 01 08:13:57 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:58 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 1073741824" returned: 0 in 0.434s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:58 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 Apr 01 08:13:58 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:58 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" returned: 0 in 0.364s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e1ad75-2e4f-4976-a2a9-e7d5867437df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a63e6de-a070-4d91-aa2a-cc4a60c0cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:13:58 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Volume volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 (59ae26fe-6d5f-4d95-b738-0c50292ee0f0): created successfully Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a63e6de-a070-4d91-aa2a-cc4a60c0cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:13:58 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Flow 'volume_create_manager' (19703f7f-82cb-4b56-869d-774b84c8efef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:13:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-22460266-849e-4a3d-a4db-1a7e66723bf5 tempest-CinderUnicodeTest-568864871 None] Created volume successfully. Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Creating offline snapshot 16c665b8-6512-4a35-82a1-b27e3cc63527 of volume 59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd23860-963a-404b-ab82-7019c0f79621]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:59 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 Apr 01 08:13:59 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:59 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" returned: 0 in 0.420s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:13:59 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 1G Apr 01 08:13:59 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:13:59 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 1G" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:13:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:00 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 Apr 01 08:14:00 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:00 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527" returned: 0 in 0.387s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:00 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 is being set with open permissions: ugo+rw Apr 01 08:14:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:00 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 Apr 01 08:14:00 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:00 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527" returned: 0 in 0.358s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:00 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info Apr 01 08:14:00 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:01 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:01 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info is being set with open permissions: ugo+rw Apr 01 08:14:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:01 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info Apr 01 08:14:01 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:01 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.info" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:01 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-12107125-7d57-4c96-90e9-9a8be77b3ab9 tempest-CinderUnicodeTest-568864871 None] Create snapshot completed successfully Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-16c665b8-6512-4a35-82a1-b27e3cc63527-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-16c665b8-6512-4a35-82a1-b27e3cc63527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-quobyte-16c665b8-6512-4a35-82a1-b27e3cc63527" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-16c665b8-6512-4a35-82a1-b27e3cc63527" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Deleting offline snapshot 16c665b8-6512-4a35-82a1-b27e3cc63527 of volume 59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] snapshot_file for this snap is: volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c8f99b-0a08-4d2d-80e8-c1f459263927]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:02 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 Apr 01 08:14:02 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:02 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[81469f35-a5e4-43ee-9c4a-93d16c6a6809]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:02 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 Apr 01 08:14:02 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:03 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" returned: 0 in 0.429s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:03 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 Apr 01 08:14:03 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:03 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527" returned: 0 in 0.393s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:03 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527 Apr 01 08:14:03 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:03 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0.16c665b8-6512-4a35-82a1-b27e3cc63527" returned: 0 in 0.356s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-16c665b8-6512-4a35-82a1-b27e3cc63527" released by "_delete_snapshot" :: held 1.665s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" released by "delete_snapshot" :: held 1.677s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Created reservations ['2d72c545-46b9-47b0-86a9-49d9e41e0d98', 'fa29eef5-50f4-448f-9428-2a2d3f81a183', 'b3e508ce-6bcf-420d-b708-8067c164fa96', '7a184360-b2f1-415b-935d-892fd946618c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Delete snapshot completed successfully. Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-bb7e3162-e7b4-4b0d-990d-be6256cfa6a5 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-16c665b8-6512-4a35-82a1-b27e3cc63527-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-59ae26fe-6d5f-4d95-b738-0c50292ee0f0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-59ae26fe-6d5f-4d95-b738-0c50292ee0f0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fdc305-ec16-468f-a9a7-3cd13fdce59b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:04 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 Apr 01 08:14:04 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:04 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:04 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0 Apr 01 08:14:04 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:05 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-59ae26fe-6d5f-4d95-b738-0c50292ee0f0" released by "delete_volume" :: held 0.827s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Created reservations ['582641d0-8cc6-4ded-952d-28a67432e5d7', '4cc8f153-953b-4039-aabe-30f7fc5e0ce9', '94c911bf-d139-4d20-be13-ae827e03d261', '9fc9cdb8-8faa-41fd-8d69-02de852b7f33'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:05 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:05 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-993c7b9a-9b67-4814-9202-e68af11c6fbb-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-993c7b9a-9b67-4814-9202-e68af11c6fbb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "cinder-quobyte-993c7b9a-9b67-4814-9202-e68af11c6fbb" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-993c7b9a-9b67-4814-9202-e68af11c6fbb" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808d345-6c20-4967-b1d5-782d0022da0a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:05 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb Apr 01 08:14:05 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:05 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:05 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Deleted volume successfully. Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-473660db-6ccf-4904-b9ef-32e003b1cde6 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-59ae26fe-6d5f-4d95-b738-0c50292ee0f0-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:05 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:05 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb Apr 01 08:14:05 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:06 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-993c7b9a-9b67-4814-9202-e68af11c6fbb" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-quobyte-993c7b9a-9b67-4814-9202-e68af11c6fbb" released by "delete_volume" :: held 0.825s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Created reservations ['38293716-71b0-4068-9acb-f64bd5d38c3d', 'e15fe44b-5e83-4585-8c07-b600b8afa806', '68355bfc-0457-4606-872a-4128aa7afd9b', 'a0f31b26-be5d-49f0-9a3d-dd438f372d93'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:06 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:06 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:06 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.383s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Deleted volume successfully. Apr 01 08:14:06 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1b106259-3dc7-4560-9ef4-bf1c28747d22 tempest-CinderUnicodeTest-568864871 None] Lock "cinder-993c7b9a-9b67-4814-9202-e68af11c6fbb-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (812331aa-3fd8-44cb-a7ba-ac4006586248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f14f5-ab4d-439a-aeb3-35e5f9b92946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (9dbba957-86a5-4507-86eb-0ec4559a3de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949283c2-6e58-4ccc-8c88-2b4cfb73d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55f14f5-ab4d-439a-aeb3-35e5f9b92946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2052293517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:13Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081e460-4c12-4c38-b1d8-5d4d2a0142e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081e460-4c12-4c38-b1d8-5d4d2a0142e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1017944e-4aed-4031-b101-a9d0e761dcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1017944e-4aed-4031-b101-a9d0e761dcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb', 'volume_name': 'volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9187c917-9a42-4c34-9e1c-0f3ac8e8a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9187c917-9a42-4c34-9e1c-0f3ac8e8a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510f2276-fa3f-45d8-891c-567a7e8e8be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Volume e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb', 'volume_size': 1} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2052293517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:13Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Creating volume e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949283c2-6e58-4ccc-8c88-2b4cfb73d2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691800786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17832a4f-7359-45bb-8fe9-8db8ebaba139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:13Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f33dce-dff4-4648-9d1d-2da776b86765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f33dce-dff4-4648-9d1d-2da776b86765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cbfbb-52fe-4599-9973-187896cd38e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cbfbb-52fe-4599-9973-187896cd38e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17832a4f-7359-45bb-8fe9-8db8ebaba139', 'volume_name': 'volume-17832a4f-7359-45bb-8fe9-8db8ebaba139', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc3ec01-baa3-4815-bbd5-21b96eee7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc3ec01-baa3-4815-bbd5-21b96eee7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42453428-856d-42f8-9dda-7a34e04e014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume 17832a4f-7359-45bb-8fe9-8db8ebaba139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17832a4f-7359-45bb-8fe9-8db8ebaba139', 'volume_size': 1} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:13 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb 1073741824 Apr 01 08:14:13 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (619139a0-0279-4b8e-b273-d7d8757a29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e8887d-8b8d-4a90-be36-52d956c7b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e8887d-8b8d-4a90-be36-52d956c7b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627616674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07be3de-5503-4168-8180-37dbe5016d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e829b1ad-4886-49db-96bf-7efd9d5e4503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e829b1ad-4886-49db-96bf-7efd9d5e4503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96391a59-7d6e-4fdf-895a-bc9ba1f0ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96391a59-7d6e-4fdf-895a-bc9ba1f0ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07be3de-5503-4168-8180-37dbe5016d9e', 'volume_name': 'volume-d07be3de-5503-4168-8180-37dbe5016d9e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32f9c1c-6d87-4f48-99ed-d6ce1378e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32f9c1c-6d87-4f48-99ed-d6ce1378e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49786e0-c8ff-43d4-9546-204fc67e6565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Volume d07be3de-5503-4168-8180-37dbe5016d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07be3de-5503-4168-8180-37dbe5016d9e', 'volume_size': 1} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (c52477ff-c461-4a97-934b-50a33ba6d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a1dff3-94c4-41cc-a53f-fc081ce1a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a1dff3-94c4-41cc-a53f-fc081ce1a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026637939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670b46a9-605b-478b-8127-15c7accfa6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd44202-a239-40fe-943d-529d55cf0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd44202-a239-40fe-943d-529d55cf0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25a7321-69a4-49f3-9217-0e0c7804ac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25a7321-69a4-49f3-9217-0e0c7804ac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670b46a9-605b-478b-8127-15c7accfa6be', 'volume_name': 'volume-670b46a9-605b-478b-8127-15c7accfa6be', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbca5c7-d199-4742-9b01-2b7dca5f8813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbca5c7-d199-4742-9b01-2b7dca5f8813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e8d07d-032d-4c38-8291-b2f142ee268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Volume 670b46a9-605b-478b-8127-15c7accfa6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670b46a9-605b-478b-8127-15c7accfa6be', 'volume_size': 1} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (8fd2df2d-ab6c-4e0a-bf02-0688993a04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c07cab-e105-42b4-840c-e13ef1792b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c07cab-e105-42b4-840c-e13ef1792b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1335692335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cb340f-341b-4f07-ae30-6420085eca8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd53e76-c450-44d9-b011-c5991bfeb0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd53e76-c450-44d9-b011-c5991bfeb0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b56a5bf-e629-46aa-ba47-8bc0bffb4448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b56a5bf-e629-46aa-ba47-8bc0bffb4448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cb340f-341b-4f07-ae30-6420085eca8a', 'volume_name': 'volume-79cb340f-341b-4f07-ae30-6420085eca8a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5ebda9-db73-46d9-821a-f67988e65489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5ebda9-db73-46d9-821a-f67988e65489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2257bd23-7707-4669-97c0-4c2d5497423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:13 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Volume 79cb340f-341b-4f07-ae30-6420085eca8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cb340f-341b-4f07-ae30-6420085eca8a', 'volume_size': 1} Apr 01 08:14:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (18a8b046-35d5-4dda-a6c2-12c9129ab0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6592b-03fb-4651-b2ad-29fce8d9fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6592b-03fb-4651-b2ad-29fce8d9fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633470496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16629c86-fe74-4b05-ad0c-819de59f565e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f846fc3-69d2-4687-bab2-93deaf95984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f846fc3-69d2-4687-bab2-93deaf95984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5765597-6a08-4897-ae07-a9ada287f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5765597-6a08-4897-ae07-a9ada287f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16629c86-fe74-4b05-ad0c-819de59f565e', 'volume_name': 'volume-16629c86-fe74-4b05-ad0c-819de59f565e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad56c72b-1202-42f1-83a7-9c54eae97b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad56c72b-1202-42f1-83a7-9c54eae97b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac3f24d-267d-44ab-91d5-4d3bfeb1b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Volume 16629c86-fe74-4b05-ad0c-819de59f565e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16629c86-fe74-4b05-ad0c-819de59f565e', 'volume_size': 1} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:14 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb 1073741824" returned: 0 in 0.688s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:14 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb Apr 01 08:14:14 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (5815b1bb-2b32-4f93-9f90-d512e675c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80acead7-4269-4f8d-826d-6bf36aabdd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80acead7-4269-4f8d-826d-6bf36aabdd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637137712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd16d576-3527-4151-9d06-e9bf9558a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b13ec70-f5e4-403c-8a3c-1606e5ce7904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b13ec70-f5e4-403c-8a3c-1606e5ce7904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ad1f4e-d0a7-42ed-bc9a-8760256e426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ad1f4e-d0a7-42ed-bc9a-8760256e426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd16d576-3527-4151-9d06-e9bf9558a4d0', 'volume_name': 'volume-bd16d576-3527-4151-9d06-e9bf9558a4d0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c16853-8dbb-443b-894b-711c5f049338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c16853-8dbb-443b-894b-711c5f049338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8055a179-cf22-468e-baf0-b844523f7133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Volume bd16d576-3527-4151-9d06-e9bf9558a4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd16d576-3527-4151-9d06-e9bf9558a4d0', 'volume_size': 1} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:14 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" returned: 0 in 0.416s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691800786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17832a4f-7359-45bb-8fe9-8db8ebaba139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:13Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume 17832a4f-7359-45bb-8fe9-8db8ebaba139 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:14 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510f2276-fa3f-45d8-891c-567a7e8e8be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b651d1de-8822-4d47-82e0-932c50d19a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:14 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 1073741824 Apr 01 08:14:14 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:14 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Volume volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb (e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb): created successfully Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b651d1de-8822-4d47-82e0-932c50d19a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:14 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (812331aa-3fd8-44cb-a7ba-ac4006586248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1cc273d3-fc2c-418c-987f-1bb7e689e487 tempest-CreateVolumesFromImageTest-378573345 None] Created volume successfully. Apr 01 08:14:15 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 1073741824" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:15 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 Apr 01 08:14:15 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:15 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139" returned: 0 in 0.422s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627616674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07be3de-5503-4168-8180-37dbe5016d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Creating volume d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:15 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42453428-856d-42f8-9dda-7a34e04e014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17832a4f-7359-45bb-8fe9-8db8ebaba139', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e8a33-28dd-4ed3-bc13-245563160162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:15 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e 1073741824 Apr 01 08:14:15 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:15 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 (17832a4f-7359-45bb-8fe9-8db8ebaba139): created successfully Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e8a33-28dd-4ed3-bc13-245563160162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:15 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (9dbba957-86a5-4507-86eb-0ec4559a3de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d238c6cd-ebdb-421d-a0ff-e5bee1154310 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:16 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e 1073741824" returned: 0 in 0.478s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:16 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:16 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:16 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.497s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.736s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026637939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670b46a9-605b-478b-8127-15c7accfa6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Creating volume 670b46a9-605b-478b-8127-15c7accfa6be {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:16 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49786e0-c8ff-43d4-9546-204fc67e6565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07be3de-5503-4168-8180-37dbe5016d9e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7b6dc-f541-4832-85f8-5701e4238e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Volume volume-d07be3de-5503-4168-8180-37dbe5016d9e (d07be3de-5503-4168-8180-37dbe5016d9e): created successfully Apr 01 08:14:16 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be 1073741824 Apr 01 08:14:16 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7b6dc-f541-4832-85f8-5701e4238e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (619139a0-0279-4b8e-b273-d7d8757a29a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:16 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d31e9a34-9529-474d-828b-1cc3ad82b587 tempest-VolumeDependencyTests-2012031152 None] Created volume successfully. Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (f903ccb3-dd92-402c-99d6-079502997e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add75ee7-90fa-41bc-bf47-e729dbbcdae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add75ee7-90fa-41bc-bf47-e729dbbcdae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728142320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9666e41-c337-4b8a-9538-c7f9fa1aac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d31b751-283f-48bf-b77e-5c7e8c849f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d31b751-283f-48bf-b77e-5c7e8c849f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e991a1-747e-4ebe-a338-ede1d9d03c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e991a1-747e-4ebe-a338-ede1d9d03c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9666e41-c337-4b8a-9538-c7f9fa1aac19', 'volume_name': 'volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d4a2e0-8f83-47ca-9eac-354df0c890a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d4a2e0-8f83-47ca-9eac-354df0c890a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2344d9-2cbd-43f8-b85d-eb2cfb1c7a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:16 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume c9666e41-c337-4b8a-9538-c7f9fa1aac19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19', 'volume_size': 1} Apr 01 08:14:16 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (ba63d469-5f65-4cc4-baee-ce53abe25883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0572c840-3c70-49d9-93a6-97711b6fb167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0572c840-3c70-49d9-93a6-97711b6fb167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202732953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df91e2ce-4eed-40e6-9147-cea1969779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df91e2ce-4eed-40e6-9147-cea1969779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d849e9ae-4693-49c2-9922-061530de12d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d849e9ae-4693-49c2-9922-061530de12d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0', 'volume_name': 'volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4e33d3-f4a8-440f-9ff3-3665515073e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4e33d3-f4a8-440f-9ff3-3665515073e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8c2a07-5754-48c7-80e9-8fd9ad6ce63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume 15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0', 'volume_size': 1} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (63923d3d-e427-4467-b353-fcc5794562dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5b72e2-70e0-40c7-b57b-6fce306d5f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5b72e2-70e0-40c7-b57b-6fce306d5f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535928199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba397421-6549-40bc-849b-22990c653588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acc53a3-ecba-4a4d-a519-8e65aefabf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acc53a3-ecba-4a4d-a519-8e65aefabf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4543586e-762b-4763-b423-bc9a34c72b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4543586e-762b-4763-b423-bc9a34c72b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba397421-6549-40bc-849b-22990c653588', 'volume_name': 'volume-ba397421-6549-40bc-849b-22990c653588', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a8281f-86aa-4685-80f9-b8c9939181e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a8281f-86aa-4685-80f9-b8c9939181e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667ef2c8-e815-4521-ad02-f59dd5d96471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume ba397421-6549-40bc-849b-22990c653588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba397421-6549-40bc-849b-22990c653588', 'volume_size': 1} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be 1073741824" returned: 0 in 0.751s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:17 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be Apr 01 08:14:17 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (dc743375-0af2-4b58-897d-688df060d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a87bc0c-befa-48ff-a32b-6fc5117c7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a87bc0c-befa-48ff-a32b-6fc5117c7280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127278364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ddf4d-15c8-465b-bc11-756e5ade82b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb7c8e6-e5ba-45ef-80c3-b03ff08b4658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb7c8e6-e5ba-45ef-80c3-b03ff08b4658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2883b34b-2f5a-490b-a38f-9506a126f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2883b34b-2f5a-490b-a38f-9506a126f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97ddf4d-15c8-465b-bc11-756e5ade82b5', 'volume_name': 'volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e4a8c2-477a-41be-9595-c50635f162e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e4a8c2-477a-41be-9595-c50635f162e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8610a56-8a4a-4436-9ad9-39d9ea10acc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume f97ddf4d-15c8-465b-bc11-756e5ade82b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5', 'volume_size': 1} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (fde4f466-4703-4a8f-b6f4-9090d26d367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5113c4-46b8-4ba5-82e7-f4f14b9cba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5113c4-46b8-4ba5-82e7-f4f14b9cba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615729040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94b04c2-da7b-483e-be3b-6297850b3338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:18Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2f603-a853-4056-9b2c-001409779769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2f603-a853-4056-9b2c-001409779769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2109ce9d-1fac-4e88-a60c-b0f303558216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2109ce9d-1fac-4e88-a60c-b0f303558216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94b04c2-da7b-483e-be3b-6297850b3338', 'volume_name': 'volume-b94b04c2-da7b-483e-be3b-6297850b3338', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc99cd8-5738-44cb-904b-f3d0c8c9123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc99cd8-5738-44cb-904b-f3d0c8c9123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ab936e-4411-43dc-bb77-9a8492fd13e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume b94b04c2-da7b-483e-be3b-6297850b3338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94b04c2-da7b-483e-be3b-6297850b3338', 'volume_size': 1} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be" returned: 0 in 0.541s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.985s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1335692335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cb340f-341b-4f07-ae30-6420085eca8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Creating volume 79cb340f-341b-4f07-ae30-6420085eca8a {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e8d07d-032d-4c38-8291-b2f142ee268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670b46a9-605b-478b-8127-15c7accfa6be', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a 1073741824 Apr 01 08:14:17 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6130bf-2cab-4d7b-87b3-8613b34ce120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Volume volume-670b46a9-605b-478b-8127-15c7accfa6be (670b46a9-605b-478b-8127-15c7accfa6be): created successfully Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6130bf-2cab-4d7b-87b3-8613b34ce120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:17 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (c52477ff-c461-4a97-934b-50a33ba6d146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:17 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d75c9f14-a0e4-4ebc-a4ac-c653655bb840 tempest-CreateVolumesFromImageTest-378573345 None] Created volume successfully. Apr 01 08:14:18 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a 1073741824" returned: 0 in 0.579s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:18 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a Apr 01 08:14:18 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:18 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.784s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633470496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16629c86-fe74-4b05-ad0c-819de59f565e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Creating volume 16629c86-fe74-4b05-ad0c-819de59f565e {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:18 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2257bd23-7707-4669-97c0-4c2d5497423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cb340f-341b-4f07-ae30-6420085eca8a', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:18 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e 1073741824 Apr 01 08:14:18 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f4b4a-0d0e-43fa-a026-37440ff76c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:18 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Volume volume-79cb340f-341b-4f07-ae30-6420085eca8a (79cb340f-341b-4f07-ae30-6420085eca8a): created successfully Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f4b4a-0d0e-43fa-a026-37440ff76c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:18 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (8fd2df2d-ab6c-4e0a-bf02-0688993a04db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:18 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d2e94750-1d9c-48ca-a1c5-16e5e0246be2 tempest-CreateVolumesFromImageTest-378573345 None] Created volume successfully. Apr 01 08:14:19 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e 1073741824" returned: 0 in 0.491s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:19 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e Apr 01 08:14:19 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:19 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e" returned: 0 in 0.419s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.490s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637137712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd16d576-3527-4151-9d06-e9bf9558a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a13ddded55d48ef9628f254dd5843bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:14Z,use_quota=True,user_id='b489b62d4841424ea3e15c62dbb07655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Creating volume bd16d576-3527-4151-9d06-e9bf9558a4d0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:19 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac3f24d-267d-44ab-91d5-4d3bfeb1b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16629c86-fe74-4b05-ad0c-819de59f565e', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19898949-37b7-4f11-9c73-b80bee4066b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:19 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 1073741824 Apr 01 08:14:19 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:19 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Volume volume-16629c86-fe74-4b05-ad0c-819de59f565e (16629c86-fe74-4b05-ad0c-819de59f565e): created successfully Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19898949-37b7-4f11-9c73-b80bee4066b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:19 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (18a8b046-35d5-4dda-a6c2-12c9129ab0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:19 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-fa9ecb81-c180-46ec-bc35-4b98d4b14112 tempest-CreateVolumesFromImageTest-378573345 None] Created volume successfully. Apr 01 08:14:20 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 1073741824" returned: 0 in 0.490s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:20 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 Apr 01 08:14:20 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:20 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0" returned: 0 in 0.487s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.894s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728142320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9666e41-c337-4b8a-9538-c7f9fa1aac19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume c9666e41-c337-4b8a-9538-c7f9fa1aac19 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:20 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8055a179-cf22-468e-baf0-b844523f7133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd16d576-3527-4151-9d06-e9bf9558a4d0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ad0239-e03d-4f20-9078-b056042eec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:20 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 1073741824 Apr 01 08:14:20 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:20 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Volume volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 (bd16d576-3527-4151-9d06-e9bf9558a4d0): created successfully Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ad0239-e03d-4f20-9078-b056042eec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:20 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Flow 'volume_create_manager' (5815b1bb-2b32-4f93-9f90-d512e675c22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:20 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2a695e53-5b48-4df8-afd9-76432fbe2ced tempest-CreateVolumesFromImageTest-378573345 None] Created volume successfully. Apr 01 08:14:21 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 1073741824" returned: 0 in 0.549s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:21 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 Apr 01 08:14:21 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:21 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.720s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202732953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume 15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:21 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2344d9-2cbd-43f8-b85d-eb2cfb1c7a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:21 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 1073741824 Apr 01 08:14:21 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517ccc71-33db-4e66-8305-0f92d4a90aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:21 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 (c9666e41-c337-4b8a-9538-c7f9fa1aac19): created successfully Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517ccc71-33db-4e66-8305-0f92d4a90aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (f903ccb3-dd92-402c-99d6-079502997e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:21 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-f6c48e4f-5b2b-4fed-a2c3-387ae773d919 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-bd16d576-3527-4151-9d06-e9bf9558a4d0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:21 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-bd16d576-3527-4151-9d06-e9bf9558a4d0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-quobyte-bd16d576-3527-4151-9d06-e9bf9558a4d0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-bd16d576-3527-4151-9d06-e9bf9558a4d0" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13dc5fc-b829-4352-823b-75510d74e7b8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:22 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 Apr 01 08:14:22 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:22 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0" returned: 0 in 0.470s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:22 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 1073741824" returned: 0 in 0.610s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:22 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0 Apr 01 08:14:22 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:22 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 Apr 01 08:14:22 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:22 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-bd16d576-3527-4151-9d06-e9bf9558a4d0" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-bd16d576-3527-4151-9d06-e9bf9558a4d0" released by "delete_volume" :: held 0.913s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Created reservations ['a1d9b90f-4611-428e-a027-5f885c8ee096', '8a8f7fd7-c944-4681-8c49-472a9408df40', '8640e4db-b725-443e-865e-4937d687b23a', 'cc1696af-6990-40f6-bc94-5075626bc0e9'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:22 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" returned: 0 in 0.453s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:22 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.822s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8c2a07-5754-48c7-80e9-8fd9ad6ce63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdfb520-2a80-4ab5-83cc-cdadaf1bac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:23 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 (15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0): created successfully Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdfb520-2a80-4ab5-83cc-cdadaf1bac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (ba63d469-5f65-4cc4-baee-ce53abe25883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-098d065b-2009-4dab-b366-0aa658be99d1 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Creating offline snapshot bf283cb7-2274-419c-87d7-59f96efeab58 of volume d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61d152-a814-4e46-ab4c-f69c058843e7]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-16629c86-fe74-4b05-ad0c-819de59f565e-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-16629c86-fe74-4b05-ad0c-819de59f565e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:23 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:23 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-quobyte-16629c86-fe74-4b05-ad0c-819de59f565e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:23 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:23 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-16629c86-fe74-4b05-ad0c-819de59f565e" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e3f04-5555-4f3e-bf91-83352f71f729]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:23 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e Apr 01 08:14:23 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:23 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.508s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:23 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 1G Apr 01 08:14:23 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:23 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.532s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:23 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Deleted volume successfully. Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e43df0ad-65fb-44f9-af78-47c3be08b770 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-bd16d576-3527-4151-9d06-e9bf9558a4d0-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:23 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e" returned: 0 in 0.545s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:23 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:23 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e Apr 01 08:14:23 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:24 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 1G" returned: 0 in 0.565s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07be3de-5503-4168-8180-37dbe5016d9e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:24 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07be3de-5503-4168-8180-37dbe5016d9e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:24 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:24 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-16629c86-fe74-4b05-ad0c-819de59f565e" returned: 0 in 0.481s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-16629c86-fe74-4b05-ad0c-819de59f565e" released by "delete_volume" :: held 1.051s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Created reservations ['ea74d307-72a7-4fc2-b2cf-f51c390e2806', '7abeb381-c744-44ba-b2e4-cd06ac163822', 'e035c133-2575-41b9-a555-79b27be93855', '1545128c-7bad-4579-9d13-1cff8062073e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:24 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:24 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:24 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07be3de-5503-4168-8180-37dbe5016d9e -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:24 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 is being set with open permissions: ugo+rw Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:24 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:24 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:24 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.424s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:24 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Deleted volume successfully. Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-08502f1c-df53-47a5-b87c-ea3f5e7b9f91 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-16629c86-fe74-4b05-ad0c-819de59f565e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:24 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:24 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.392s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:25 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info Apr 01 08:14:25 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-79cb340f-341b-4f07-ae30-6420085eca8a-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-79cb340f-341b-4f07-ae30-6420085eca8a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-quobyte-79cb340f-341b-4f07-ae30-6420085eca8a" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-79cb340f-341b-4f07-ae30-6420085eca8a" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c99f26-dfc7-407e-bfa8-eb82d6c94828]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:25 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a Apr 01 08:14:25 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:25 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:25 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info is being set with open permissions: ugo+rw Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:25 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info Apr 01 08:14:25 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:25 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a" returned: 0 in 0.509s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:25 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a Apr 01 08:14:25 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:25 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.info" returned: 0 in 0.427s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.610s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535928199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba397421-6549-40bc-849b-22990c653588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume ba397421-6549-40bc-849b-22990c653588 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:25 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:25 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:25 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 1073741824 Apr 01 08:14:25 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:25 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-16f4b75c-1ab6-4c96-b95a-2c3c683a5fc3 tempest-VolumeDependencyTests-2012031152 None] Create snapshot completed successfully Apr 01 08:14:26 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-79cb340f-341b-4f07-ae30-6420085eca8a" returned: 0 in 0.464s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-79cb340f-341b-4f07-ae30-6420085eca8a" released by "delete_volume" :: held 1.006s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Created reservations ['f828da07-6c7c-4c69-82d8-493f789563ca', 'c39af266-8eee-4c1d-954a-acc55627c8ed', '9baffcdb-1051-4f57-bcee-648d14cf84b7', '4f09203a-a9bf-4b46-9420-140109ac28fc'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:26 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:26 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:26 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 1073741824" returned: 0 in 0.614s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:26 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 Apr 01 08:14:26 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (d2d315cb-5f32-4b7a-9539-ae1655d20dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf53d503-ed50-4e88-ad5a-c237d3a9aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf53d503-ed50-4e88-ad5a-c237d3a9aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1741853069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e95c352-66ab-4ae3-8c00-2f4e84f67d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf283cb7-2274-419c-87d7-59f96efeab58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:27Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ff6624-8b92-456c-ac3f-9c7f77dc9b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ff6624-8b92-456c-ac3f-9c7f77dc9b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4ace05-63d1-472c-b881-53d4f7aca411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4ace05-63d1-472c-b881-53d4f7aca411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e95c352-66ab-4ae3-8c00-2f4e84f67d34', 'volume_name': 'volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34', 'volume_size': 1, 'snapshot_id': 'bf283cb7-2274-419c-87d7-59f96efeab58'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0e3da3-8b30-4e2b-87fe-94b49b8504bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0e3da3-8b30-4e2b-87fe-94b49b8504bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a848b939-edb3-4940-be16-641dc781b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Volume 9e95c352-66ab-4ae3-8c00-2f4e84f67d34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34', 'volume_size': 1, 'snapshot_id': 'bf283cb7-2274-419c-87d7-59f96efeab58'} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:26 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.467s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:26 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Deleted volume successfully. Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c276d90a-ef70-4cda-a3cf-e512e3794629 tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-79cb340f-341b-4f07-ae30-6420085eca8a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Flow 'volume_create_manager' (a8a7b3ff-888d-4711-a84a-6a1644027c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43625be3-0250-4fbc-838b-9e9642cdd9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:26 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43625be3-0250-4fbc-838b-9e9642cdd9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2099173538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fe640d-e84b-4787-a38d-055b96d5b1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d96a2e3b9a64ddbaeecf782bf74706d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:27Z,use_quota=True,user_id='776d8b5797e84869890263f3448967f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ad5adf-d637-40f4-89d8-7c9fe8c25194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ad5adf-d637-40f4-89d8-7c9fe8c25194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0a6253-6b4a-440c-9023-80737e6c19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0a6253-6b4a-440c-9023-80737e6c19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fe640d-e84b-4787-a38d-055b96d5b1f5', 'volume_name': 'volume-75fe640d-e84b-4787-a38d-055b96d5b1f5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb0fc1c-2d6a-48a1-91b1-cbf8ee75c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:27 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb0fc1c-2d6a-48a1-91b1-cbf8ee75c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0c8abe-2d98-47a8-9b8e-50457267247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:27 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Volume 75fe640d-e84b-4787-a38d-055b96d5b1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fe640d-e84b-4787-a38d-055b96d5b1f5', 'volume_size': 1} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588" returned: 0 in 0.480s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.544s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127278364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ddf4d-15c8-465b-bc11-756e5ade82b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:17Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume f97ddf4d-15c8-465b-bc11-756e5ade82b5 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:27 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667ef2c8-e815-4521-ad02-f59dd5d96471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba397421-6549-40bc-849b-22990c653588', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f31ca7-56be-406b-a054-2bf63f2895c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:27 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 1073741824 Apr 01 08:14:27 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:27 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-ba397421-6549-40bc-849b-22990c653588 (ba397421-6549-40bc-849b-22990c653588): created successfully Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f31ca7-56be-406b-a054-2bf63f2895c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (63923d3d-e427-4467-b353-fcc5794562dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:27 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-56f495ab-59b5-4e6f-8ad2-6b83719738ad tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-670b46a9-605b-478b-8127-15c7accfa6be-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-670b46a9-605b-478b-8127-15c7accfa6be-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-quobyte-670b46a9-605b-478b-8127-15c7accfa6be" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-670b46a9-605b-478b-8127-15c7accfa6be" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:27 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 1073741824" returned: 0 in 0.503s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f04361-9ec0-4935-92f0-7dd661354d1f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:27 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 Apr 01 08:14:27 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:27 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be Apr 01 08:14:27 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:27 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:27 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5" returned: 0 in 0.421s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:27 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.251s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615729040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94b04c2-da7b-483e-be3b-6297850b3338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df889c40d50143f096a7b25780a9fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:18Z,use_quota=True,user_id='dbac5560c20d4d7f9b5f85b8d21d3a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Creating volume b94b04c2-da7b-483e-be3b-6297850b3338 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:28 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8610a56-8a4a-4436-9ad9-39d9ea10acc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7365072-03e3-452f-a1d1-1e7a33967bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:28 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 1073741824 Apr 01 08:14:28 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be" returned: 0 in 0.484s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:28 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 (f97ddf4d-15c8-465b-bc11-756e5ade82b5): created successfully Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7365072-03e3-452f-a1d1-1e7a33967bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:28 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be Apr 01 08:14:28 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (dc743375-0af2-4b58-897d-688df060d795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:28 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-eaa6bb60-aaf3-450c-972c-dbc9403a4e4b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:28 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-670b46a9-605b-478b-8127-15c7accfa6be" returned: 0 in 0.421s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-670b46a9-605b-478b-8127-15c7accfa6be" released by "delete_volume" :: held 0.924s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:28 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Created reservations ['b7fc02c6-401e-42a7-8883-2fb43d8cbc5a', '96522119-c7c1-4a82-9604-7c6cf5c10b8f', 'b87bcce4-45d3-4ddf-98b4-d98aa415bc22', '953b7469-9a6c-41ee-9196-75b3be91c973'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 1073741824" returned: 0 in 0.489s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:28 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:28 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:28 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 Apr 01 08:14:28 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "cinder-quobyte-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c5bc04-61ef-4f63-b898-737b6bb2496f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:28 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb Apr 01 08:14:28 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:28 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.406s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:28 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Deleted volume successfully. Apr 01 08:14:28 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338" returned: 0 in 0.400s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.121s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c057ed3b-f868-4aab-ba1b-5024d796e18a tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-670b46a9-605b-478b-8127-15c7accfa6be-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ab936e-4411-43dc-bb77-9a8492fd13e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94b04c2-da7b-483e-be3b-6297850b3338', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a319e2a-2f70-4108-a7f4-2dd70317cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:28 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Volume volume-b94b04c2-da7b-483e-be3b-6297850b3338 (b94b04c2-da7b-483e-be3b-6297850b3338): created successfully Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a319e2a-2f70-4108-a7f4-2dd70317cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Flow 'volume_create_manager' (fde4f466-4703-4a8f-b6f4-9090d26d367d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Creating volume 9e95c352-66ab-4ae3-8c00-2f4e84f67d34 from snapshot bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:28 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:29 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-379b06e9-1150-4453-843e-eb434a667c9f tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created volume successfully. Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] snapshot: bf283cb7-2274-419c-87d7-59f96efeab58, volume: 9e95c352-66ab-4ae3-8c00-2f4e84f67d34, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c51dc42-43f6-4be3-8688-7aacc4c0f7b3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:29 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:29 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:29 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" returned: 0 in 0.473s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:29 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb Apr 01 08:14:29 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:29 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.461s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d07be3de-5503-4168-8180-37dbe5016d9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-b94b04c2-da7b-483e-be3b-6297850b3338-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cc06c-dfd6-4e44-98ac-3248b567de4a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-b94b04c2-da7b-483e-be3b-6297850b3338-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:29 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" returned: 0 in 0.432s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-quobyte-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb" released by "delete_volume" :: held 0.946s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-b94b04c2-da7b-483e-be3b-6297850b3338" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-b94b04c2-da7b-483e-be3b-6297850b3338" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67fcdd0-66a7-4dc9-b1ad-d4caaf619ee1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:29 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:29 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Created reservations ['766d4171-84c2-4256-bc48-399a98a36fdd', '0069ce8e-2e15-4ba7-a4da-54f1db79d27f', '0254ee81-e86e-45d4-8a42-865911e930e8', '1e95e480-9365-40a2-a8aa-004ef07fbfdc'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:29 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:29 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:29 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:29 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:29 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:30 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.610s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:30 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 Apr 01 08:14:30 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:30 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338" returned: 0 in 0.617s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:30 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338 Apr 01 08:14:30 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:30 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.569s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:30 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Deleted volume successfully. Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-943d74ba-4b21-421e-b65b-75c473f291ce tempest-CreateVolumesFromImageTest-378573345 None] Lock "cinder-e7ff82ed-b0fc-439f-bd28-6fe573a0e7eb-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:30 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-b94b04c2-da7b-483e-be3b-6297850b3338" returned: 0 in 0.641s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-b94b04c2-da7b-483e-be3b-6297850b3338" released by "delete_volume" :: held 1.288s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:30 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['50ee4e04-23b1-4987-81ef-663b75c75301', '9c14c7dc-f2db-487e-ada3-4cee687f964d', '599ff6c1-a266-4200-ab9c-ef3ff9630de5', 'd6507794-68f2-4b45-8442-533a5f51df3c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:31 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:31 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-f97ddf4d-15c8-465b-bc11-756e5ade82b5-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-f97ddf4d-15c8-465b-bc11-756e5ade82b5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-f97ddf4d-15c8-465b-bc11-756e5ade82b5" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:31 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-f97ddf4d-15c8-465b-bc11-756e5ade82b5" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234f35b-7603-40ca-a557-ea91e2ed916a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:32 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.903s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:32 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-afe3dad3-1403-43de-84e7-af63e036ca68 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-b94b04c2-da7b-483e-be3b-6297850b3338-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:32 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 Apr 01 08:14:32 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:32 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" returned: 0 in 2.321s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e9e6bf-2c4a-49f9-b1fa-ac13f26618a9]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:32 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:32 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:32 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5" returned: 0 in 0.779s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:32 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5 Apr 01 08:14:32 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (2818d66f-45bb-4b71-a7f5-888703bfd946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e1ea29-75e4-488f-ad06-cf3e70f34444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e1ea29-75e4-488f-ad06-cf3e70f34444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447618523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50255040-2560-4bd9-85ef-7c688d93b5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:33Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb74c11-b8a8-4740-8d10-84356cefa08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb74c11-b8a8-4740-8d10-84356cefa08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaec695b-5ba5-451e-a1c3-132464170222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaec695b-5ba5-451e-a1c3-132464170222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50255040-2560-4bd9-85ef-7c688d93b5f2', 'volume_name': 'volume-50255040-2560-4bd9-85ef-7c688d93b5f2', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1db619-1136-4c92-a2ba-7d911d707e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1db619-1136-4c92-a2ba-7d911d707e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f345b-2252-48bc-9744-e3a266d02c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:32 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume 50255040-2560-4bd9-85ef-7c688d93b5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50255040-2560-4bd9-85ef-7c688d93b5f2', 'volume_size': 1} Apr 01 08:14:32 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:33 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.625s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:14:33 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Converted 1024.00 MB image at 441.06 MB/s Apr 01 08:14:33 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 is being set with open permissions: ugo+rw Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:33 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 Apr 01 08:14:33 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:33 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f97ddf4d-15c8-465b-bc11-756e5ade82b5" returned: 0 in 0.405s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-f97ddf4d-15c8-465b-bc11-756e5ade82b5" released by "delete_volume" :: held 1.255s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['2b2d5de2-22a9-4b9e-8e6a-e1df668cd9a9', 'dae39090-5353-404a-83b6-66fdee09e9b2', '26899093-a3d9-4861-b510-52e89d47a8dd', 'a76ffcff-f44b-4e8c-8c2f-44387006c703'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:33 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:33 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:33 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" returned: 0 in 0.421s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" released by "_copy_volume_from_snapshot" :: held 4.499s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" released by "_create_volume_from_snapshot" :: held 4.523s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.562s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.497s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2099173538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fe640d-e84b-4787-a38d-055b96d5b1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d96a2e3b9a64ddbaeecf782bf74706d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:27Z,use_quota=True,user_id='776d8b5797e84869890263f3448967f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Creating volume 75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:33 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:33 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 1073741824 Apr 01 08:14:33 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a848b939-edb3-4940-be16-641dc781b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34', 'volume_size': 1, 'snapshot_id': 'bf283cb7-2274-419c-87d7-59f96efeab58'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781150d9-d3bb-4314-a694-626041014aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:33 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Volume volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 (9e95c352-66ab-4ae3-8c00-2f4e84f67d34): created successfully Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781150d9-d3bb-4314-a694-626041014aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (d2d315cb-5f32-4b7a-9539-ae1655d20dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:33 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-094bfeec-317e-4ead-b0ab-25ca422516fd tempest-VolumeDependencyTests-2012031152 None] Created volume successfully. Apr 01 08:14:33 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.375s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:33 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-c9323c8e-1c1d-44b1-a9c6-64eac7b962eb tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-f97ddf4d-15c8-465b-bc11-756e5ade82b5-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:33 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:33 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 1073741824" returned: 0 in 0.463s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:34 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-ba397421-6549-40bc-849b-22990c653588-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-ba397421-6549-40bc-849b-22990c653588-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-ba397421-6549-40bc-849b-22990c653588" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-ba397421-6549-40bc-849b-22990c653588" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[870502a1-5667-4ac5-83b3-efc34a57483b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 Apr 01 08:14:34 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-bf283cb7-2274-419c-87d7-59f96efeab58-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-bf283cb7-2274-419c-87d7-59f96efeab58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Deleting offline snapshot bf283cb7-2274-419c-87d7-59f96efeab58 of volume d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:14:34 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] snapshot_file for this snap is: volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.440s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c2427-95e1-4ee9-acc2-060af28ec3b1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447618523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50255040-2560-4bd9-85ef-7c688d93b5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:33Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume 50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:34 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0c8abe-2d98-47a8-9b8e-50457267247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fe640d-e84b-4787-a38d-055b96d5b1f5', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:34 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 1073741824 Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca83a598-abb7-423e-aa25-a36ad4225e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:34 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Volume volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 (75fe640d-e84b-4787-a38d-055b96d5b1f5): created successfully Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca83a598-abb7-423e-aa25-a36ad4225e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Flow 'volume_create_manager' (a8a7b3ff-888d-4711-a84a-6a1644027c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:34 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a13ee7f7-1164-4d1d-9d8f-da38639b88af tempest-SnapshotDependencyTests-1943387394 None] Created volume successfully. Apr 01 08:14:34 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:34 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588" returned: 0 in 0.503s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588 Apr 01 08:14:34 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 1073741824" returned: 0 in 0.472s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:34 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.487s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d07be3de-5503-4168-8180-37dbe5016d9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:34 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 Apr 01 08:14:34 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c195987-3bf5-48b7-a5da-789ac0803606]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:34 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:35 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:35 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-ba397421-6549-40bc-849b-22990c653588" returned: 0 in 0.430s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-ba397421-6549-40bc-849b-22990c653588" released by "delete_volume" :: held 0.956s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['ad86b90c-05ac-4882-88cf-34cf9ffd4f55', 'c890e8b1-cc51-45a3-8a44-522cf9accb55', 'fe44cb06-8eef-42a4-a220-ef2e712c6486', '1b7f91e0-a21a-4dbd-8cdf-92a2f235b72b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:35 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d753775-24f2-4de2-8b2d-19a5ae664979]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 Apr 01 08:14:35 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:35 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2" returned: 0 in 0.460s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f345b-2252-48bc-9744-e3a266d02c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50255040-2560-4bd9-85ef-7c688d93b5f2', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79915ff-3840-475c-bf96-37d5ff29ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:35 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-50255040-2560-4bd9-85ef-7c688d93b5f2 (50255040-2560-4bd9-85ef-7c688d93b5f2): created successfully Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79915ff-3840-475c-bf96-37d5ff29ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (2818d66f-45bb-4b71-a7f5-888703bfd946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d01f76d4-3b76-45fe-92f2-ccd12e0f56d8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:35 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.537s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:35 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:35 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.448s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:35 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ee5f6dbb-823e-4fab-b423-d9b1fb8bc503 tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-ba397421-6549-40bc-849b-22990c653588-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Creating offline snapshot f4133dba-b0c4-4af5-85f4-acadf37cbf40 of volume 75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac168f-cc8d-4351-8b4e-d91a990dcb63]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" returned: 0 in 0.543s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:35 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:35 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0 Apr 01 08:14:35 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:35 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:35 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:36 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.602s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:36 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58 Apr 01 08:14:36 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:36 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" returned: 0 in 0.492s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0" released by "delete_volume" :: held 1.057s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.539s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:36 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 1G Apr 01 08:14:36 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['e54f8aae-0aa3-492d-8fc9-166220ecf36f', 'eca2cb61-af8e-4947-a73b-58f8f400e090', '7602aeba-1fa6-4bc5-b2a2-cd9e4baeb073', '268e6f82-8f77-466a-8aaf-b5013c28241c'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:36 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:36 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:36 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e.bf283cb7-2274-419c-87d7-59f96efeab58" returned: 0 in 0.438s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-bf283cb7-2274-419c-87d7-59f96efeab58" released by "_delete_snapshot" :: held 2.158s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" released by "delete_snapshot" :: held 2.170s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Created reservations ['ab8d76f7-6c6d-4b86-83ea-a035e707d1d8', 'c6028067-5160-4f35-b0fa-c2877373cc53', '299c1336-8ba7-4f5b-8d3d-bb4a1df2095c', '3d1ee4a2-257e-45c0-92ec-07cd155ccd51'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Delete snapshot completed successfully. Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-576072a3-1707-4d7b-943f-bb028f315e78 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-bf283cb7-2274-419c-87d7-59f96efeab58-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:36 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.411s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:36 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:36 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 1G" returned: 0 in 0.509s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:36 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-542122dc-d570-4b52-a326-33b6465c233c tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-15b3f6a2-bd03-47fd-b5a2-8eafca0ca0e0-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:36 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:36 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:37 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:37 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 is being set with open permissions: ugo+rw Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:37 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:37 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-c9666e41-c337-4b8a-9538-c7f9fa1aac19-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-c9666e41-c337-4b8a-9538-c7f9fa1aac19-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-c9666e41-c337-4b8a-9538-c7f9fa1aac19" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-c9666e41-c337-4b8a-9538-c7f9fa1aac19" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[91277353-033f-4e6b-8661-bcc781ba9974]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:37 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 Apr 01 08:14:37 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-d07be3de-5503-4168-8180-37dbe5016d9e-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-d07be3de-5503-4168-8180-37dbe5016d9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d78140-4926-4add-9f80-ce61b1d70153]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:37 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.413s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:37 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info Apr 01 08:14:37 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:37 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:37 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:37 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19" returned: 0 in 0.502s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:37 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:37 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19 Apr 01 08:14:37 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:38 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info is being set with open permissions: ugo+rw Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info Apr 01 08:14:38 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.553s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e Apr 01 08:14:38 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-c9666e41-c337-4b8a-9538-c7f9fa1aac19" returned: 0 in 0.402s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-c9666e41-c337-4b8a-9538-c7f9fa1aac19" released by "delete_volume" :: held 0.929s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['65fc23af-1804-4e2a-b3ff-1a223e5b8d14', '278b4dca-2c2d-41b4-b74a-34bcd6313d32', 'fdb4e04f-4356-4812-adeb-8659fe3d4da8', '10476774-9967-4eda-915e-b3f92c1b3cc7'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:38 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.info" returned: 0 in 0.395s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.318s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating offline snapshot b23dff05-7740-4d78-8f1d-92227d350769 of volume 50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-17832a4f-7359-45bb-8fe9-8db8ebaba139-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f55d34-892d-443a-9104-0ceb8a02834f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-17832a4f-7359-45bb-8fe9-8db8ebaba139-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:38 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-2f9666af-ce0a-45d2-9d21-401e11217310 tempest-SnapshotDependencyTests-1943387394 None] Create snapshot completed successfully Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "cinder-quobyte-17832a4f-7359-45bb-8fe9-8db8ebaba139" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:38 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-d07be3de-5503-4168-8180-37dbe5016d9e" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-17832a4f-7359-45bb-8fe9-8db8ebaba139" acquired by "delete_volume" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-d07be3de-5503-4168-8180-37dbe5016d9e" released by "delete_volume" :: held 1.039s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f762a7-dafd-4d5f-b6a3-ce4fdf382008]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 Apr 01 08:14:38 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Created reservations ['7d782ee2-5fdc-4bad-ad11-5953e17eb49c', 'aa629d50-4fea-4f1c-bc23-ac0dbc621504', '7c58e25c-407c-479b-9b44-7becfc06ed12', '799a4c25-e57c-4153-ae59-889cb9f6f9be'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:38 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 Apr 01 08:14:38 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:38 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:38 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:38 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:39 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.563s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:39 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-113646df-77ea-40b9-93af-f62d2f128a7b tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-c9666e41-c337-4b8a-9538-c7f9fa1aac19-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:39 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2" returned: 0 in 0.613s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:39 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 1G Apr 01 08:14:39 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Flow 'volume_create_manager' (e79d09a6-68df-452a-b164-e011f4bfd09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb005d38-c74b-4cde-ba8e-764a23a1fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb005d38-c74b-4cde-ba8e-764a23a1fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628f9597-185f-445f-b974-61e6e2941b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d96a2e3b9a64ddbaeecf782bf74706d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4133dba-b0c4-4af5-85f4-acadf37cbf40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:39Z,use_quota=True,user_id='776d8b5797e84869890263f3448967f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761b8b8b-5cb1-4b64-bbb8-4aa93a620aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761b8b8b-5cb1-4b64-bbb8-4aa93a620aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad88875-a2a6-4b81-9c84-829172441473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad88875-a2a6-4b81-9c84-829172441473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '628f9597-185f-445f-b974-61e6e2941b05', 'volume_name': 'volume-628f9597-185f-445f-b974-61e6e2941b05', 'volume_size': 1, 'snapshot_id': 'f4133dba-b0c4-4af5-85f4-acadf37cbf40'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99129626-bd9f-4439-b538-17605b49dea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99129626-bd9f-4439-b538-17605b49dea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:39 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395743b1-71e8-41e3-a595-0bebebf9cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:39 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Volume 628f9597-185f-445f-b974-61e6e2941b05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-628f9597-185f-445f-b974-61e6e2941b05', 'volume_size': 1, 'snapshot_id': 'f4133dba-b0c4-4af5-85f4-acadf37cbf40'} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139" returned: 0 in 0.615s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:39 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139 Apr 01 08:14:39 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:39 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.575s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:39 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Deleted volume successfully. Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-888d447c-7023-4f5a-b082-ca46c05f9f9d tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-d07be3de-5503-4168-8180-37dbe5016d9e-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:39 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 1G" returned: 0 in 0.459s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50255040-2560-4bd9-85ef-7c688d93b5f2 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:39 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50255040-2560-4bd9-85ef-7c688d93b5f2 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 Apr 01 08:14:39 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:39 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-17832a4f-7359-45bb-8fe9-8db8ebaba139" returned: 0 in 0.428s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-quobyte-17832a4f-7359-45bb-8fe9-8db8ebaba139" released by "delete_volume" :: held 1.066s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Created reservations ['397110dd-ddde-42d0-ad11-48dfc3f13219', '27a38564-0dcd-4c90-b2bd-291d4f62d250', 'c21d4232-4648-4a77-b69b-61b7bcbd0fbe', '5e7c499f-130c-48b9-be78-1b71b0594fc9'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:39 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:39 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:39 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (92c9a46f-5a8e-4888-bf6d-f5fa8d744a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93263c34-00fd-44fb-a32c-eefb5a25d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93263c34-00fd-44fb-a32c-eefb5a25d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-813961407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c90ac2-4526-495a-b913-5891de70f5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:40Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2986ae-2954-4646-8fa2-56f0b1d4fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2986ae-2954-4646-8fa2-56f0b1d4fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25552285-6ba9-4798-aece-711eeb208945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25552285-6ba9-4798-aece-711eeb208945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c90ac2-4526-495a-b913-5891de70f5e1', 'volume_name': 'volume-68c90ac2-4526-495a-b913-5891de70f5e1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a8a72f-784c-4aed-b9ae-3ed233f4bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a8a72f-784c-4aed-b9ae-3ed233f4bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206c1a63-45a6-4f4f-95b1-a42983d073c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:40 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Volume 68c90ac2-4526-495a-b913-5891de70f5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c90ac2-4526-495a-b913-5891de70f5e1', 'volume_size': 1} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:40 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50255040-2560-4bd9-85ef-7c688d93b5f2 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:40 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 is being set with open permissions: ugo+rw Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:40 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 Apr 01 08:14:40 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:40 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.387s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:40 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Deleted volume successfully. Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-332b0d3f-6e71-4f09-807b-898b56cad1fc tempest-CreateVolumesFromSourceVolumeTest-238305485 None] Lock "cinder-17832a4f-7359-45bb-8fe9-8db8ebaba139-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:40 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769" returned: 0 in 0.402s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:40 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info Apr 01 08:14:40 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:40 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info" returned: 0 in 0.439s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:40 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info is being set with open permissions: ugo+rw Apr 01 08:14:40 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:40 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info Apr 01 08:14:41 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:41 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.info" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.157s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40-628f9597-185f-445f-b974-61e6e2941b05" by "_create_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40-628f9597-185f-445f-b974-61e6e2941b05" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Creating volume 628f9597-185f-445f-b974-61e6e2941b05 from snapshot f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:41 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-0096501b-5590-4b81-8a67-fbab9c879835 tempest-CreateVolumesFromSnapshotTest-816163923 None] Create snapshot completed successfully Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] snapshot: f4133dba-b0c4-4af5-85f4-acadf37cbf40, volume: 628f9597-185f-445f-b974-61e6e2941b05, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d623fac-75bb-4768-9d76-a70c0cd4f5b3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:41 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:41 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:41 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.475s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75fe640d-e84b-4787-a38d-055b96d5b1f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:41 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e4ee8-e2ce-4818-b393-4beeb93455e1]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:42 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:42 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:42 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.476s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:42 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 Apr 01 08:14:42 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (54bddf09-b842-49c3-bc0a-15b28fffe4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bda2d2c-4807-406e-bc5a-6de5b5236abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bda2d2c-4807-406e-bc5a-6de5b5236abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-986876175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff1728-1972-4dae-86df-6650767050ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda2ce4f-7cb8-40b7-8a89-8fa774e90da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda2ce4f-7cb8-40b7-8a89-8fa774e90da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e8570d-d27f-4724-a7bf-3629870c075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e8570d-d27f-4724-a7bf-3629870c075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ff1728-1972-4dae-86df-6650767050ad', 'volume_name': 'volume-21ff1728-1972-4dae-86df-6650767050ad', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d278774d-7a54-4d23-bb62-ba7455165c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d278774d-7a54-4d23-bb62-ba7455165c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73daad3d-9b05-47db-97db-f9893faf88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume 21ff1728-1972-4dae-86df-6650767050ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ff1728-1972-4dae-86df-6650767050ad', 'volume_size': 1} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (1c73ff0d-c126-4277-b1f2-219bab605876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83178874-ef05-4e15-bc66-58b0ea724a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83178874-ef05-4e15-bc66-58b0ea724a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635622687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7351fcc8-11ba-4539-b69d-6a21ac05e029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9097c34d-3fbd-4848-b29d-9fc3dfea7363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9097c34d-3fbd-4848-b29d-9fc3dfea7363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592ea44d-373f-409a-bf4b-77b7df736626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592ea44d-373f-409a-bf4b-77b7df736626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7351fcc8-11ba-4539-b69d-6a21ac05e029', 'volume_name': 'volume-7351fcc8-11ba-4539-b69d-6a21ac05e029', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3a42ca-7278-47ed-8728-2e783658af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3a42ca-7278-47ed-8728-2e783658af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a3bb33-bfd0-486b-9a24-10a8ceac2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:42 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume 7351fcc8-11ba-4539-b69d-6a21ac05e029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7351fcc8-11ba-4539-b69d-6a21ac05e029', 'volume_size': 1} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:42 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (41157895-2092-40ca-9876-a65b5285cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b25fad-de79-41d6-89d1-3abc3815a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b25fad-de79-41d6-89d1-3abc3815a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037016188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c1fec-e994-4cb1-bbb4-4f4694337488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61038ee-2105-415e-ad31-4b1ebe1d97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61038ee-2105-415e-ad31-4b1ebe1d97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d38c7-17ec-4785-bfbf-8d7994d24c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d38c7-17ec-4785-bfbf-8d7994d24c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8c1fec-e994-4cb1-bbb4-4f4694337488', 'volume_name': 'volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a85488-91f7-48cd-b5cc-2f036599370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a85488-91f7-48cd-b5cc-2f036599370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006ca4f-a1b9-4f3a-9d5b-c9a4af6336fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume fa8c1fec-e994-4cb1-bbb4-4f4694337488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488', 'volume_size': 1} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (5dd723dc-10ff-4596-8f4e-b60f36a4f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb08a18-73ea-4299-b709-21304793bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb08a18-73ea-4299-b709-21304793bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1475802902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e844eb-c0f6-4ece-bf57-da094c88b821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:44Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a62675-066b-40d7-94a6-643b956f6427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a62675-066b-40d7-94a6-643b956f6427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f368672f-ad06-42d1-b167-9f0f286f7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f368672f-ad06-42d1-b167-9f0f286f7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e844eb-c0f6-4ece-bf57-da094c88b821', 'volume_name': 'volume-12e844eb-c0f6-4ece-bf57-da094c88b821', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32cee2c-1f1b-48bd-87cf-05d9ec5f1f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32cee2c-1f1b-48bd-87cf-05d9ec5f1f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec1a3d8-4250-4cb1-8e58-f3e0f4695f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:43 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume 12e844eb-c0f6-4ece-bf57-da094c88b821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e844eb-c0f6-4ece-bf57-da094c88b821', 'volume_size': 1} Apr 01 08:14:43 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (f9a5248e-73fe-4e06-b94e-18199f8e669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8244265-bb83-4234-a7d2-aeb11d43e37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8244265-bb83-4234-a7d2-aeb11d43e37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044634610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532c0f3d-32d7-4f5e-88a0-49c90bf589d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:44Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb1f283-9a05-4f9d-8aa5-a7cac722ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb1f283-9a05-4f9d-8aa5-a7cac722ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4000929-bfbb-40f2-a186-2cab43723b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4000929-bfbb-40f2-a186-2cab43723b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532c0f3d-32d7-4f5e-88a0-49c90bf589d3', 'volume_name': 'volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf670665-fcec-44b3-96c2-3a3a919ce0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf670665-fcec-44b3-96c2-3a3a919ce0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5573f96d-96bf-4c08-b759-ef097bd15eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:44 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume 532c0f3d-32d7-4f5e-88a0-49c90bf589d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3', 'volume_size': 1} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:44 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05" returned: 0 in 2.105s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccca0f7-2269-48bf-b2d8-5d75d92e23ac]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:44 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:44 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:44 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:45 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.546s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:14:45 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Converted 1024.00 MB image at 486.19 MB/s Apr 01 08:14:45 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 is being set with open permissions: ugo+rw Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:45 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 Apr 01 08:14:45 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:45 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05" returned: 0 in 0.376s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" released by "_copy_volume_from_snapshot" :: held 4.035s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40-628f9597-185f-445f-b974-61e6e2941b05" released by "_create_volume_from_snapshot" :: held 4.056s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.080s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.457s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-813961407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c90ac2-4526-495a-b913-5891de70f5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:40Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Creating volume 68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:45 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:45 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 1073741824 Apr 01 08:14:45 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395743b1-71e8-41e3-a595-0bebebf9cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628f9597-185f-445f-b974-61e6e2941b05', 'volume_size': 1, 'snapshot_id': 'f4133dba-b0c4-4af5-85f4-acadf37cbf40'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4414a70-bdca-40c8-aa27-7256299a5df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:45 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Volume volume-628f9597-185f-445f-b974-61e6e2941b05 (628f9597-185f-445f-b974-61e6e2941b05): created successfully Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4414a70-bdca-40c8-aa27-7256299a5df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Flow 'volume_create_manager' (e79d09a6-68df-452a-b164-e011f4bfd09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:45 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-3000934e-a169-42fc-bd23-4b52f3516c5a tempest-SnapshotDependencyTests-1943387394 None] Created volume successfully. Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-f4133dba-b0c4-4af5-85f4-acadf37cbf40-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-f4133dba-b0c4-4af5-85f4-acadf37cbf40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Deleting offline snapshot f4133dba-b0c4-4af5-85f4-acadf37cbf40 of volume 75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] snapshot_file for this snap is: volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd237aa9-1b79-427a-8de6-a574d539089b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:45 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:45 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:45 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:46 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 1073741824" returned: 0 in 0.477s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:46 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:14:46 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:46 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.463s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75fe640d-e84b-4787-a38d-055b96d5b1f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c12a7d-5b0f-4a5c-8dd9-5ebb5567b4b5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:46 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:46 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:46 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.448s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.842s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-986876175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff1728-1972-4dae-86df-6650767050ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume 21ff1728-1972-4dae-86df-6650767050ad {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:46 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=167,cinder:INSERT=44,cinder:UPDATE=247,cinder:DELETE=19 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206c1a63-45a6-4f4f-95b1-a42983d073c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c90ac2-4526-495a-b913-5891de70f5e1', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c2c3ba-c5a9-47cf-9e8a-58b7fe9727bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:46 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad 1073741824 Apr 01 08:14:46 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:SELECT=181,cinder:INSERT=69,cinder:UPDATE=231,cinder:DELETE=23 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 01 08:14:46 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Volume volume-68c90ac2-4526-495a-b913-5891de70f5e1 (68c90ac2-4526-495a-b913-5891de70f5e1): created successfully Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c2c3ba-c5a9-47cf-9e8a-58b7fe9727bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (92c9a46f-5a8e-4888-bf6d-f5fa8d744a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:46 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9fefe29f-2a59-49b2-859c-f3b8549bdd15 tempest-VolumeDependencyTests-2012031152 None] Created volume successfully. Apr 01 08:14:46 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.438s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:46 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:46 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:46 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad 1073741824" returned: 0 in 0.464s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:46 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:47 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad Apr 01 08:14:47 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:47 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.458s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:47 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40 Apr 01 08:14:47 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:47 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.534s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635622687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7351fcc8-11ba-4539-b69d-6a21ac05e029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume 7351fcc8-11ba-4539-b69d-6a21ac05e029 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:47 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73daad3d-9b05-47db-97db-f9893faf88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ff1728-1972-4dae-86df-6650767050ad', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 1073741824 Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4797bd8f-79c9-4172-bbef-ec4b56168b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:47 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-21ff1728-1972-4dae-86df-6650767050ad (21ff1728-1972-4dae-86df-6650767050ad): created successfully Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4797bd8f-79c9-4172-bbef-ec4b56168b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (54bddf09-b842-49c3-bc0a-15b28fffe4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:47 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-39c2dad1-8bb7-4932-ac97-d018d7cb8113 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:47 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5.f4133dba-b0c4-4af5-85f4-acadf37cbf40" returned: 0 in 0.412s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-f4133dba-b0c4-4af5-85f4-acadf37cbf40" released by "_delete_snapshot" :: held 1.829s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" released by "delete_snapshot" :: held 1.847s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Created reservations ['bb6d2d63-2b00-414f-9575-43d126724970', '8ed42c50-8e98-43e1-9155-a321a0d7f612', 'fb18a516-f75a-43ed-8c6e-7725c3bdc852', 'f2a494d3-0181-40e1-bbde-2e272002e663'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:47 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Delete snapshot completed successfully. Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-31f5cb8a-888b-4116-8662-a03f79561740 tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-f4133dba-b0c4-4af5-85f4-acadf37cbf40-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (c53d2371-4160-45f8-a140-d79f73461af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16f5cad-99bb-4881-bc7a-6b546cdaba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16f5cad-99bb-4881-bc7a-6b546cdaba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-739086350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cb76ae-62a9-44da-92ad-f8fa7577f05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319c4b6d7e74bb6b7e800ba35b6fc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=68c90ac2-4526-495a-b913-5891de70f5e1,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:48Z,use_quota=True,user_id='5986d3c3690045c884b101d25d3913b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31635b32-09d3-45ef-98b7-ba960dd716f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31635b32-09d3-45ef-98b7-ba960dd716f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be80bc-f493-4706-9d92-bc96c5c468b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be80bc-f493-4706-9d92-bc96c5c468b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f0cb76ae-62a9-44da-92ad-f8fa7577f05e', 'volume_name': 'volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e', 'volume_size': 1, 'source_volid': '68c90ac2-4526-495a-b913-5891de70f5e1', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62b5d5d-461e-4ea7-b9e1-c03d6f097ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62b5d5d-461e-4ea7-b9e1-c03d6f097ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee79b9-e534-405a-8aea-8ae7b81fc4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:47 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Volume f0cb76ae-62a9-44da-92ad-f8fa7577f05e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e', 'volume_size': 1, 'source_volid': '68c90ac2-4526-495a-b913-5891de70f5e1', 'source_volstatus': 'available'} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 1073741824" returned: 0 in 0.538s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-75fe640d-e84b-4787-a38d-055b96d5b1f5-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:47 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 Apr 01 08:14:47 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:47 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-75fe640d-e84b-4787-a38d-055b96d5b1f5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" acquired by "delete_volume" :: waited 0.005s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b918268e-8825-4c42-9bda-2dce4e40a17a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:48 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:48 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:48 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029" returned: 0 in 0.412s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.228s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037016188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c1fec-e994-4cb1-bbb4-4f4694337488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:43Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume fa8c1fec-e994-4cb1-bbb4-4f4694337488 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:48 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a3bb33-bfd0-486b-9a24-10a8ceac2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7351fcc8-11ba-4539-b69d-6a21ac05e029', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:48 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 1073741824 Apr 01 08:14:48 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6dfb0-75b5-4adf-8831-29263bd3830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:48 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 (7351fcc8-11ba-4539-b69d-6a21ac05e029): created successfully Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6dfb0-75b5-4adf-8831-29263bd3830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (1c73ff0d-c126-4277-b1f2-219bab605876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:48 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-22b10f97-d55a-48f2-8452-577659bef432 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:48 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.488s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:48 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5 Apr 01 08:14:48 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:48 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 1073741824" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:48 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 Apr 01 08:14:48 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:48 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-75fe640d-e84b-4787-a38d-055b96d5b1f5" returned: 0 in 0.389s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-75fe640d-e84b-4787-a38d-055b96d5b1f5" released by "delete_volume" :: held 0.907s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Created reservations ['f2feee68-8575-47dc-ae6b-44dc82c638e7', 'faf83386-0a76-4145-a1e6-319e8ad81ca0', '4d6b1948-6b19-4cc4-9394-2ea67a2b8409', 'bb1359ad-9eda-468c-8be1-5fb43160ec66'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:48 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:48 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:48 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-628f9597-185f-445f-b974-61e6e2941b05-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-628f9597-185f-445f-b974-61e6e2941b05-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34edc63-6093-4e50-8fe2-34dd4f91225c]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:49 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:49 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 Apr 01 08:14:49 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488" returned: 0 in 0.408s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.250s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1475802902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e844eb-c0f6-4ece-bf57-da094c88b821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:44Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume 12e844eb-c0f6-4ece-bf57-da094c88b821 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:49 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006ca4f-a1b9-4f3a-9d5b-c9a4af6336fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24eb56b-a8dc-454e-b05b-8e325bffa67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:49 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 1073741824 Apr 01 08:14:49 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:49 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 (fa8c1fec-e994-4cb1-bbb4-4f4694337488): created successfully Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24eb56b-a8dc-454e-b05b-8e325bffa67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (41157895-2092-40ca-9876-a65b5285cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e921bb61-ece7-4fdf-8ae2-0bd54e49a1a8 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:49 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.410s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:49 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Deleted volume successfully. Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-382d6dda-1662-4877-bce9-514cc72d23ee tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-75fe640d-e84b-4787-a38d-055b96d5b1f5-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:49 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:49 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05 Apr 01 08:14:49 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:49 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 1073741824" returned: 0 in 0.479s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:49 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 Apr 01 08:14:49 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:49 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-628f9597-185f-445f-b974-61e6e2941b05" returned: 0 in 0.375s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:49 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-quobyte-628f9597-185f-445f-b974-61e6e2941b05" released by "delete_volume" :: held 0.859s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Created reservations ['821863d2-4c66-4d26-82b0-9cddf99ed7cd', '0d2aa582-135b-4489-b619-a0e97a0b419e', '673a59d0-886c-4471-8875-42b76530a158', '337d1d91-e427-437b-96a0-0e9ee97a1824'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:50 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:50 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:50 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821" returned: 0 in 0.399s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.613s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044634610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532c0f3d-32d7-4f5e-88a0-49c90bf589d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe02bf7fbafb40deb4d2474e2805e81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:14:44Z,use_quota=True,user_id='46d9d2e082774f0abf2c2bb15d4c648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Creating volume 532c0f3d-32d7-4f5e-88a0-49c90bf589d3 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:14:50 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:50 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 1073741824 Apr 01 08:14:50 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec1a3d8-4250-4cb1-8e58-f3e0f4695f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e844eb-c0f6-4ece-bf57-da094c88b821', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c43f02-ace7-4e3b-8854-1701527361ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:50 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-12e844eb-c0f6-4ece-bf57-da094c88b821 (12e844eb-c0f6-4ece-bf57-da094c88b821): created successfully Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c43f02-ace7-4e3b-8854-1701527361ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (5dd723dc-10ff-4596-8f4e-b60f36a4f931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-98cd39eb-5b8e-4139-89eb-8a10e3f163f2 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:50 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.404s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:50 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Deleted volume successfully. Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-44eb2463-e43e-4dd9-843e-3a1ac0503f3f tempest-SnapshotDependencyTests-1943387394 None] Lock "cinder-628f9597-185f-445f-b974-61e6e2941b05-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:50 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 1073741824" returned: 0 in 0.518s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:50 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:50 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 Apr 01 08:14:50 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:51 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.229s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:51 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Cloning volume 68c90ac2-4526-495a-b913-5891de70f5e1 to volume f0cb76ae-62a9-44da-92ad-f8fa7577f05e Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5573f96d-96bf-4c08-b759-ef097bd15eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f49239e-aa88-4ffa-a689-2bc97b3702f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:14:51 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Volume volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 (532c0f3d-32d7-4f5e-88a0-49c90bf589d3): created successfully Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f49239e-aa88-4ffa-a689-2bc97b3702f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Flow 'volume_create_manager' (f9a5248e-73fe-4e06-b94e-18199f8e669a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:14:51 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-378b4dd4-0b1d-4a27-b7f0-0b98aa83e350 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created volume successfully. Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Creating offline snapshot eb9290f6-70fd-4796-a505-b314e4581ecb of volume 68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e90df5-25da-49b6-8fe3-29311ef2154a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:51 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:14:51 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:51 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.483s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:51 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb 1G Apr 01 08:14:51 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-532c0f3d-32d7-4f5e-88a0-49c90bf589d3-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-532c0f3d-32d7-4f5e-88a0-49c90bf589d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[69757ba3-dc85-4403-8758-787915b8e380]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:51 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:51 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 Apr 01 08:14:51 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:52 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb 1G" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c90ac2-4526-495a-b913-5891de70f5e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:52 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c90ac2-4526-495a-b913-5891de70f5e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:52 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:52 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" returned: 0 in 0.576s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:52 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3 Apr 01 08:14:52 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:52 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c90ac2-4526-495a-b913-5891de70f5e1 -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.442s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:52 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb is being set with open permissions: ugo+rw Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:52 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:52 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:52 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" returned: 0 in 0.447s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-532c0f3d-32d7-4f5e-88a0-49c90bf589d3" released by "delete_volume" :: held 1.051s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['d90eb43f-3260-46fe-afb4-e96131a4c300', 'd6ed27f1-6fee-475c-af31-dff4df27deef', '9a0b4575-ef24-4fba-b218-19fba689dc28', '4d7cae92-1097-45e9-befe-e65b11466a97'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:52 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:52 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:52 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:53 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:53 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info Apr 01 08:14:53 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:53 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:53 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-6ca9ccf6-de99-4801-bc63-6d92b7e59671 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-532c0f3d-32d7-4f5e-88a0-49c90bf589d3-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:53 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info" returned: 0 in 0.468s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:53 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info is being set with open permissions: ugo+rw Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:53 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info Apr 01 08:14:53 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-12e844eb-c0f6-4ece-bf57-da094c88b821-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-12e844eb-c0f6-4ece-bf57-da094c88b821-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-12e844eb-c0f6-4ece-bf57-da094c88b821" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-12e844eb-c0f6-4ece-bf57-da094c88b821" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:53 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ae903-f0b7-4a1f-8588-63f715e5f633]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:54 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 Apr 01 08:14:54 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:54 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.info" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" by "_copy_volume_from_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] snapshot: eb9290f6-70fd-4796-a505-b314e4581ecb, volume: f0cb76ae-62a9-44da-92ad-f8fa7577f05e, {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[975f026d-77ba-4c04-8819-e2bf34a6f9d8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:54 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:54 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:54 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821" returned: 0 in 0.504s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:54 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821 Apr 01 08:14:54 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:54 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.534s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c90ac2-4526-495a-b913-5891de70f5e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Creating direct copy from snapshot {{(pid=82084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad34225-37a7-4b20-b3db-ee431841ba24]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:54 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:14:54 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:54 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-12e844eb-c0f6-4ece-bf57-da094c88b821" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:54 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-12e844eb-c0f6-4ece-bf57-da094c88b821" released by "delete_volume" :: held 0.995s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['e651a3a4-4bb3-4484-a915-8d1af27cb838', 'dd2a9969-4044-4df9-8389-ed07d989ca38', '4f10da1c-636a-469a-865c-43a3a0e736bc', '399fc42f-a63c-4ca5-9ff7-217e3ad4ec4b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:55 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:55 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:55 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.521s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.utils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Path /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e not found in is_blk_device check {{(pid=82084) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:55 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e Apr 01 08:14:55 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:55 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.487s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:55 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-af54921a-d941-49ee-8589-0e6d09ab8034 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-12e844eb-c0f6-4ece-bf57-da094c88b821-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_service.periodic_task [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82084) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:55 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:55 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:55 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-fa8c1fec-e994-4cb1-bbb4-4f4694337488-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-fa8c1fec-e994-4cb1-bbb4-4f4694337488-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-fa8c1fec-e994-4cb1-bbb4-4f4694337488" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-fa8c1fec-e994-4cb1-bbb4-4f4694337488" acquired by "delete_volume" :: waited 0.026s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[423959c3-1f9d-4494-a81f-76ce65cbe68a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:56 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 Apr 01 08:14:56 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:56 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 1.140s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:56 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7e45440b-c95b-4477-a6bd-dd32f8f96bd4 None None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:57 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" returned: 0 in 2.241s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:57 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c0aa8-3b4e-4f74-8f5d-0245d238ca8b]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:57 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:14:57 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:57 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488" returned: 0 in 1.246s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:57 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:57 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488 Apr 01 08:14:57 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:58 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.567s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.image.image_utils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Image conversion details: src /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e {{(pid=82084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 01 08:14:58 devstack cinder-volume[82084]: INFO cinder.image.image_utils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Converted 1024.00 MB image at 456.68 MB/s Apr 01 08:14:58 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e is being set with open permissions: ugo+rw Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:58 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-fa8c1fec-e994-4cb1-bbb4-4f4694337488" returned: 0 in 0.393s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-fa8c1fec-e994-4cb1-bbb4-4f4694337488" released by "delete_volume" :: held 1.689s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:58 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e Apr 01 08:14:58 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['a60f22d0-7eba-45f5-b11b-825385eacff2', '7b0e3ac0-1bc2-4681-9e25-536f630d4e42', 'bc25f39c-73df-460d-a9b2-e84194cdc1ec', '97e2924f-5b6b-4e2d-b9c9-1cbcc994d1e5'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:58 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:58 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:58 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" returned: 0 in 0.386s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" released by "_copy_volume_from_snapshot" :: held 4.297s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-eb9290f6-70fd-4796-a505-b314e4581ecb" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-7351fcc8-11ba-4539-b69d-6a21ac05e029-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-eb9290f6-70fd-4796-a505-b314e4581ecb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Deleting offline snapshot eb9290f6-70fd-4796-a505-b314e4581ecb of volume 68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] snapshot_file for this snap is: volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-7351fcc8-11ba-4539-b69d-6a21ac05e029-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7979d87d-efc4-47dc-b49b-cc02e249bad8]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-7351fcc8-11ba-4539-b69d-6a21ac05e029" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-7351fcc8-11ba-4539-b69d-6a21ac05e029" acquired by "delete_volume" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[14065f53-7f70-4eae-9f9f-c6b1eb5785d5]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:58 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:58 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:58 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:14:58 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-1472b955-6e9a-43fb-96d8-c7d0e06a79f1 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-fa8c1fec-e994-4cb1-bbb4-4f4694337488-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:58 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 Apr 01 08:14:58 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:58 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.485s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c90ac2-4526-495a-b913-5891de70f5e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a80f0-48d5-4f99-90a3-841bd05e6749]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:58 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029" returned: 0 in 0.470s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029 Apr 01 08:14:59 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:14:59 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7351fcc8-11ba-4539-b69d-6a21ac05e029" returned: 0 in 0.391s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-7351fcc8-11ba-4539-b69d-6a21ac05e029" released by "delete_volume" :: held 0.882s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:14:59 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.464s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:59 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['70e46173-790b-4330-b223-ba3082dc99d0', '05a0e5ee-84b5-4492-9002-5053b3a02b1f', '97ce9f83-faff-4c92-8682-53b67859a83f', 'eab719ef-9dcd-4da2-8f40-ad636e361c91'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:14:59 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-21ff1728-1972-4dae-86df-6650767050ad-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-21ff1728-1972-4dae-86df-6650767050ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-21ff1728-1972-4dae-86df-6650767050ad" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-21ff1728-1972-4dae-86df-6650767050ad" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0a81f-b9b2-40b1-b6e9-5339cbf9ca8f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad Apr 01 08:14:59 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.431s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:14:59 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb Apr 01 08:14:59 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:14:59 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:14:59 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-65056bf2-610f-47db-91a0-e100ea4196bf tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-7351fcc8-11ba-4539-b69d-6a21ac05e029-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:00 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad" returned: 0 in 0.443s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:00 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad Apr 01 08:15:00 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:00 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1.eb9290f6-70fd-4796-a505-b314e4581ecb" returned: 0 in 0.406s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-eb9290f6-70fd-4796-a505-b314e4581ecb" released by "_delete_snapshot" :: held 1.832s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.184s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee79b9-e534-405a-8aea-8ae7b81fc4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e', 'volume_size': 1, 'source_volid': '68c90ac2-4526-495a-b913-5891de70f5e1', 'source_volstatus': 'available'}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88504144-cb88-41c8-ad02-06e2cfab595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:00 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Volume volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e (f0cb76ae-62a9-44da-92ad-f8fa7577f05e): created successfully Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88504144-cb88-41c8-ad02-06e2cfab595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Flow 'volume_create_manager' (c53d2371-4160-45f8-a140-d79f73461af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:15:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-36d0817c-ed17-4a10-80b1-96e5f1c16daf tempest-VolumeDependencyTests-2012031152 None] Created volume successfully. Apr 01 08:15:00 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-21ff1728-1972-4dae-86df-6650767050ad" returned: 0 in 0.372s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-21ff1728-1972-4dae-86df-6650767050ad" released by "delete_volume" :: held 0.841s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['c2de64ca-af96-4b92-bda0-ff1c68b9f58e', '78d9d89e-d4c1-4f09-a6f6-29e0dc079f15', '0b70ef31-d412-4a30-835f-fe01288a116f', 'a0f69879-96f2-46a1-8ab3-9dc90f1cb943'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:00 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:00 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-68c90ac2-4526-495a-b913-5891de70f5e1-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-68c90ac2-4526-495a-b913-5891de70f5e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-b23dff05-7740-4d78-8f1d-92227d350769-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-b23dff05-7740-4d78-8f1d-92227d350769-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-b23dff05-7740-4d78-8f1d-92227d350769" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-68c90ac2-4526-495a-b913-5891de70f5e1" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-b23dff05-7740-4d78-8f1d-92227d350769" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleting offline snapshot b23dff05-7740-4d78-8f1d-92227d350769 of volume 50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] snapshot_file for this snap is: volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e6b44-4554-4ca3-9b05-706f8c44e0e6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-68c90ac2-4526-495a-b913-5891de70f5e1" acquired by "delete_volume" :: waited 0.030s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f29e1a-98f5-4ef4-a689-51c8c4fd797a]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:00 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 Apr 01 08:15:00 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:00 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:15:00 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:00 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.410s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:00 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:15:00 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-d96d7f73-6f6d-465e-a222-a5fe134b152f tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-21ff1728-1972-4dae-86df-6650767050ad-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:01 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769" returned: 0 in 0.443s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50255040-2560-4bd9-85ef-7c688d93b5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64d4a8-52d8-41ad-9f63-509185551dce]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:01 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.474s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:01 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1 Apr 01 08:15:01 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:01 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 Apr 01 08:15:01 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:01 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:01 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-68c90ac2-4526-495a-b913-5891de70f5e1" returned: 0 in 0.408s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:01 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 Apr 01 08:15:01 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-68c90ac2-4526-495a-b913-5891de70f5e1" released by "delete_volume" :: held 0.911s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Created reservations ['ca0438dd-a7a2-4954-a08d-b979bc1463ef', 'be9e88bc-166a-498c-bee5-b7e1f9e2dfcf', 'cbbf74fa-42a7-4294-ba60-80223f777261', 'a5c33f9d-237a-4034-b1a3-279a85212147'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:01 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:01 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-f0cb76ae-62a9-44da-92ad-f8fa7577f05e-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-f0cb76ae-62a9-44da-92ad-f8fa7577f05e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" acquired by "delete_volume" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d8751f-b709-41d4-921e-d59d4bbf296e]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:01 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:01 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e Apr 01 08:15:01 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:02 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769" returned: 0 in 0.449s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:02 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769 Apr 01 08:15:02 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:02 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Deleted volume successfully. Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-7a42507d-4461-4780-8d36-b3d1a8d41b29 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-68c90ac2-4526-495a-b913-5891de70f5e1-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:02 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" returned: 0 in 0.469s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:02 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e Apr 01 08:15:02 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:02 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2.b23dff05-7740-4d78-8f1d-92227d350769" returned: 0 in 0.385s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-b23dff05-7740-4d78-8f1d-92227d350769" released by "_delete_snapshot" :: held 1.771s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" released by "delete_snapshot" :: held 1.786s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['1a3f2091-d0af-444c-9012-545f74575edf', '63ff0ee3-e7ed-4a86-8e7d-8f059404840c', 'e827f27e-d63d-4025-947b-39939a119774', 'bddbfdee-df64-4f8a-9b57-9beeff6e6e7b'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:02 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Delete snapshot completed successfully. Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-ccb1b53b-4eb1-48f5-ac85-d86563125fa7 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-b23dff05-7740-4d78-8f1d-92227d350769-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:02 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" returned: 0 in 0.378s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-f0cb76ae-62a9-44da-92ad-f8fa7577f05e" released by "delete_volume" :: held 0.866s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Created reservations ['ad98f401-b34f-4a44-8b0b-017f8232902b', '6ffe78c7-06e7-406a-9158-9183f058e0e4', '6f37dea7-6627-4eb3-84e8-7dd5f6e11ce0', '65b8b36e-27cd-4e47-8762-8a10e1299fb7'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:02 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:02 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-50255040-2560-4bd9-85ef-7c688d93b5f2-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-50255040-2560-4bd9-85ef-7c688d93b5f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ff35b-dafa-46b2-a104-9efb689b034f]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:02 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 Apr 01 08:15:02 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-9e95c352-66ab-4ae3-8c00-2f4e84f67d34-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:02 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-9e95c352-66ab-4ae3-8c00-2f4e84f67d34-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" acquired by "delete_volume" :: waited 0.006s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[81298ed0-f438-4e33-8ed4-08e676ef11b3]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:03 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 Apr 01 08:15:03 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:03 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.444s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:03 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Deleted volume successfully. Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-8cb16537-17fc-4423-92ed-c31a9e4ababf tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-f0cb76ae-62a9-44da-92ad-f8fa7577f05e-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:03 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2" returned: 0 in 0.456s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:03 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2 Apr 01 08:15:03 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:03 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" returned: 0 in 0.441s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:03 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34 Apr 01 08:15:03 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:03 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-50255040-2560-4bd9-85ef-7c688d93b5f2" returned: 0 in 0.388s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-quobyte-50255040-2560-4bd9-85ef-7c688d93b5f2" released by "delete_volume" :: held 0.888s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Created reservations ['9fa221a2-63f5-40b5-b6f0-23673d1efc33', '039a9ee0-02f0-42f4-a9ad-1a10b5e5d41a', 'c04d89b8-b49a-412a-bb41-6adcd9785047', 'e1e6a516-d596-4313-acf9-8aaf4fbabd65'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:03 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-quobyte-9e95c352-66ab-4ae3-8c00-2f4e84f67d34" released by "delete_volume" :: held 0.832s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:03 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:03 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Created reservations ['a340299f-9bd6-46f9-8aee-741b4c9c0389', '57668e88-ab2c-4383-b570-23afe7a3733a', '0b782965-8918-4abe-81d6-3bbcad24ca64', '03c61311-3e52-481c-b59d-27d40ab3f8c2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:03 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:03 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:03 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:04 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.454s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Deleted volume successfully. Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-cd0d44d2-6335-4dce-93ed-4663846d3220 tempest-CreateVolumesFromSnapshotTest-816163923 None] Lock "cinder-50255040-2560-4bd9-85ef-7c688d93b5f2-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:04 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:04 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Deleted volume successfully. Apr 01 08:15:04 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-321348a2-ff36-4f89-9667-f45743401eb5 tempest-VolumeDependencyTests-2012031152 None] Lock "cinder-9e95c352-66ab-4ae3-8c00-2f4e84f67d34-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Flow 'volume_create_manager' (57378b1f-9a1b-44ab-bfd9-4cf425f33f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d472210-e983-4372-91ed-e539cfb15739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d472210-e983-4372-91ed-e539cfb15739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467b719e-40be-4382-bfd6-9faf72111172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eab005581a44a5b3dda40d557271e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:15:06Z,use_quota=True,user_id='69b58336b2a1479f8306a3398488c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020e09c0-6d60-4db8-9bd1-5c2d9a7b7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020e09c0-6d60-4db8-9bd1-5c2d9a7b7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a102b41f-3ed5-4684-930b-0627b89eaf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a102b41f-3ed5-4684-930b-0627b89eaf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467b719e-40be-4382-bfd6-9faf72111172', 'volume_name': 'volume-467b719e-40be-4382-bfd6-9faf72111172', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8331a83-fa6a-4506-a3fc-9a18d18e7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8331a83-fa6a-4506-a3fc-9a18d18e7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a6776-66fa-4117-b148-843920ceb640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:05 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Volume 467b719e-40be-4382-bfd6-9faf72111172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467b719e-40be-4382-bfd6-9faf72111172', 'volume_size': 1} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467b719e-40be-4382-bfd6-9faf72111172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eab005581a44a5b3dda40d557271e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:15:06Z,use_quota=True,user_id='69b58336b2a1479f8306a3398488c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Creating volume 467b719e-40be-4382-bfd6-9faf72111172 {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:15:05 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:15:05 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:05 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 1073741824 Apr 01 08:15:05 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:06 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 1073741824" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:06 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 Apr 01 08:15:06 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:06 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a6776-66fa-4117-b148-843920ceb640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467b719e-40be-4382-bfd6-9faf72111172', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2a5ea2-36d9-470f-a5fa-00b74d632277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:06 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Volume volume-467b719e-40be-4382-bfd6-9faf72111172 (467b719e-40be-4382-bfd6-9faf72111172): created successfully Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2a5ea2-36d9-470f-a5fa-00b74d632277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:06 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Flow 'volume_create_manager' (57378b1f-9a1b-44ab-bfd9-4cf425f33f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:15:06 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-449ea109-ab17-4670-842e-f9da8e00eca2 tempest-CinderUnicodeTest-427758934 None] Created volume successfully. Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Flow 'volume_create_manager' (29bb6df7-1935-40df-9471-472a251b301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0775cae-eb38-46ea-b2a7-b8e652624c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0775cae-eb38-46ea-b2a7-b8e652624c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-376308420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a85ddfd-e093-4b80-a4d9-a6827d344e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eab005581a44a5b3dda40d557271e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:15:07Z,use_quota=True,user_id='69b58336b2a1479f8306a3398488c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2246d170-a66e-4d4b-9f71-05d1b0a5aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2246d170-a66e-4d4b-9f71-05d1b0a5aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59b0b6-bf73-46e1-b1be-b407a1fa8a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59b0b6-bf73-46e1-b1be-b407a1fa8a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a85ddfd-e093-4b80-a4d9-a6827d344e4b', 'volume_name': 'volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbe471f-5b42-4ed2-a72c-d45c3b66fb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbe471f-5b42-4ed2-a72c-d45c3b66fb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f7ba0b-fcbb-4eb1-9d6e-b718e2c15c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Volume 7a85ddfd-e093-4b80-a4d9-a6827d344e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b', 'volume_size': 1} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-01T06:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-376308420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a85ddfd-e093-4b80-a4d9-a6827d344e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eab005581a44a5b3dda40d557271e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-01T06:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-01T06:15:07Z,use_quota=True,user_id='69b58336b2a1479f8306a3398488c925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52),volume_type_id=d3c1aaac-0ec8-4e7b-8ccb-5d8ac6d0cf52)}" {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Creating volume 7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Selected osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 as target Quobyte volume. {{(pid=82084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 01 08:15:07 devstack cinder-volume[82084]: INFO cinder.volume.drivers.remotefs [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] casted to osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5 Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b 1073741824 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:07 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b 1073741824 Apr 01 08:15:07 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:07 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b 1073741824" returned: 0 in 0.436s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:07 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b Apr 01 08:15:07 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:07 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" returned: 0 in 0.372s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'} {{(pid=82084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f7ba0b-fcbb-4eb1-9d6e-b718e2c15c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b', 'volume_size': 1}' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d601ce8a-f752-4a71-bd04-82958af837f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 01 08:15:07 devstack cinder-volume[82084]: INFO cinder.volume.flows.manager.create_volume [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Volume volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b (7a85ddfd-e093-4b80-a4d9-a6827d344e4b): created successfully Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d601ce8a-f752-4a71-bd04-82958af837f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82084) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 01 08:15:07 devstack cinder-volume[82084]: DEBUG cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Flow 'volume_create_manager' (29bb6df7-1935-40df-9471-472a251b301e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82084) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 01 08:15:07 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-a671ddea-9e40-4f05-b8e1-0113e4fd87be tempest-CinderUnicodeTest-427758934 None] Created volume successfully. Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Creating offline snapshot e8a2771b-2aec-43a3-b804-bbdbacd3b525 of volume 7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5482a-3b35-4982-b1ef-5f402158d6dd]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:08 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b Apr 01 08:15:08 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:08 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" returned: 0 in 0.426s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:08 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 1G {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:08 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 1G Apr 01 08:15:08 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:09 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 1G" returned: 0 in 0.419s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:09 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 Apr 01 08:15:09 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:09 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b -F qcow2 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525" returned: 0 in 0.386s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:09 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 is being set with open permissions: ugo+rw Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:09 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 Apr 01 08:15:09 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:09 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525" returned: 0 in 0.365s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:09 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:09 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info Apr 01 08:15:09 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:10 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info" returned: 0 in 0.406s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:10 devstack cinder-volume[82084]: WARNING cinder.volume.drivers.remotefs [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info is being set with open permissions: ugo+rw Apr 01 08:15:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:10 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info Apr 01 08:15:10 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:10 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.info" returned: 0 in 0.367s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:10 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:10 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-932256ba-af37-42f8-8927-176f711f6dff tempest-CinderUnicodeTest-427758934 None] Create snapshot completed successfully Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-e8a2771b-2aec-43a3-b804-bbdbacd3b525-delete_snapshot" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-e8a2771b-2aec-43a3-b804-bbdbacd3b525-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" by "delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-quobyte-e8a2771b-2aec-43a3-b804-bbdbacd3b525" by "_delete_snapshot" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-e8a2771b-2aec-43a3-b804-bbdbacd3b525" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Deleting offline snapshot e8a2771b-2aec-43a3-b804-bbdbacd3b525 of volume 7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] snapshot_file for this snap is: volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c249df-09ed-4941-aad7-5cb7dcc4d7da]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:11 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 Apr 01 08:15:11 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:11 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525" returned: 0 in 0.423s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.remotefs [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[63296d72-8ad9-4f32-943a-0e6cb2733de2]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:11 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:11 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b Apr 01 08:15:11 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:12 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" returned: 0 in 0.424s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:12 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 Apr 01 08:15:12 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:12 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525" returned: 0 in 0.397s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:12 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:12 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525 Apr 01 08:15:12 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:13 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b.e8a2771b-2aec-43a3-b804-bbdbacd3b525" returned: 0 in 0.384s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-e8a2771b-2aec-43a3-b804-bbdbacd3b525" released by "_delete_snapshot" :: held 1.681s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" released by "delete_snapshot" :: held 1.694s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Created reservations ['4f8cb81c-0870-4909-918a-f3bc5d3e6c4d', '889e6db8-27ff-4055-bc74-714815dfc538', 'e03a42ab-454d-422e-a974-d067d2f5094a', '08d0ed78-1beb-44e4-b7dc-856600cf7a16'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:13 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Delete snapshot completed successfully. Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-45711ca6-03c0-4d13-8d17-1775edd59d05 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-e8a2771b-2aec-43a3-b804-bbdbacd3b525-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-7a85ddfd-e093-4b80-a4d9-a6827d344e4b-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "cinder-7a85ddfd-e093-4b80-a4d9-a6827d344e4b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" acquired by "delete_volume" :: waited 0.009s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c134e7-ca03-40d4-aac6-7458de2159f6]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:13 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b Apr 01 08:15:13 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:13 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" returned: 0 in 0.425s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:13 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:13 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b Apr 01 08:15:13 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:14 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" returned: 0 in 0.370s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-7a85ddfd-e093-4b80-a4d9-a6827d344e4b" released by "delete_volume" :: held 0.829s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Created reservations ['3bc288bc-d162-4826-b559-61ead2496ebf', '75ccec76-a78a-4b22-ae59-7a2319ca1857', 'bb5aa0b8-9409-4565-ae08-f743c922aece', '722e9015-4bdd-4b1a-a2ea-1e60024ab46e'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:14 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:14 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-467b719e-40be-4382-bfd6-9faf72111172-delete_volume" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-467b719e-40be-4382-bfd6-9faf72111172-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "cinder-quobyte-467b719e-40be-4382-bfd6-9faf72111172" by "delete_volume" {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-467b719e-40be-4382-bfd6-9faf72111172" acquired by "delete_volume" :: waited 0.008s {{(pid=82084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d3ef4-8873-4a9b-9742-a93cd76c70a4]: (4, 'qcow2') {{(pid=82962) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:14 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 Apr 01 08:15:14 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:14 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.386s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:14 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Deleted volume successfully. Apr 01 08:15:14 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-e26ad6a3-3831-4356-a66e-93b489cdbfbf tempest-CinderUnicodeTest-427758934 None] Lock "cinder-7a85ddfd-e093-4b80-a4d9-a6827d344e4b-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:15 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172" returned: 0 in 0.466s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:15 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172 Apr 01 08:15:15 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:15 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba/volume-467b719e-40be-4382-bfd6-9faf72111172" returned: 0 in 0.387s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-quobyte-467b719e-40be-4382-bfd6-9faf72111172" released by "delete_volume" :: held 0.883s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.quota [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Created reservations ['d1bfbc57-e8cc-4e23-8857-80acce390d85', '2b4fc568-f6a3-4ad5-9ab5-aff607e46ea2', 'c631cb38-7651-45ad-b99c-2f696ef9986f', 'd3b16012-d85e-4377-9d02-588dbf72dcb2'] {{(pid=82084) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5': None} {{(pid=82084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.volume.drivers.quobyte [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bac90acb-b455-4d98-ba22-4ed087c6c3c5'] {{(pid=82084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.lockutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82084) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 01 08:15:15 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba Apr 01 08:15:15 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 01 08:15:15 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG oslo_concurrency.processutils [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4b2d887687af72e8e9b312b622e4d3ba" returned: 0 in 0.415s {{(pid=82084) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.manager [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Notifying Schedulers of capabilities ... {{(pid=82084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 01 08:15:15 devstack cinder-volume[82084]: INFO cinder.volume.manager [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Deleted volume successfully. Apr 01 08:15:15 devstack cinder-volume[82084]: DEBUG cinder.coordination [None req-9491ee5e-c7fb-4a9a-a1cb-888dcdc99325 tempest-CinderUnicodeTest-427758934 None] Lock "cinder-467b719e-40be-4382-bfd6-9faf72111172-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82084) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 01 08:15:25 devstack cinder-volume[82084]: DEBUG dbcounter [-] [82084] Writing DB stats cinder:UPDATE=128,cinder:SELECT=90,cinder:DELETE=13,cinder:INSERT=40 {{(pid=82084) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}